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A BC NOTE 


Students learn in à number of ways and in a variety of settings. They learn 
through lectures, in informal study groups, or alone at their desks or in 
front of a computer terminal. Wherever the location, students learn most 
efficiently by solving problems, with frequent feedback from an instruc- 
tor, following a worked-out problem as a model. Worked-out problems 
have a number of positive aspects. They can capture the essence of a 
key concept — often better than paragraphs of explanation. They provide 
methods for acquiring new knowledge and for evaluating its use. They 
provide a taste of real-life issues and demonstrate techniques for solving 
real problems. Most important, they encourage active participation in 
learning. 

We created the BookWare Companion Series because we saw an un- 


fulfilled need for computer-based learning tools that address the compu- . 


tational aspects of problem solving across the curriculum. The BC series 
concept was also shaped by other forces: a general agreement among in- 
structors that students learn best when they are actively involved in their 
own learning, and the realization that textbooks have not kept up with or 
matched student learning needs. Educators and publishers are just begin- 
ning to understand that the amount of material crammed into most text- 
books cannot be absorbed, let alone the knowledge to be mastered in four 
years of undergraduate study. Rather than attempting to teach students 
all the latest knowledge, colleges and universities are now striving to teach 
them to reason: to understand the relationships and connections between 
new information and existing knowledge; and to cultivate problem-solving 
skills, intuition, and critical thinking. The BookWare Companion Series 
was developed in response to this changing mission. 

Specifically, the BookWare Companion Series was designed for educa- 
tors who wish to integrate their curriculum with computer-based learning 
tools, and for students who find their current textbooks overwhelming. 
The former will find in the BookWare Companion Series the means by 
which to use powerful software tools to support their course activities, 
without having to customize the applications themselves. The latter will 
find relevant problems and examples quickly and easily and have instant 
electronic access to them. 
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We hope that the BC series will become a clearinghouse for the ex- 
change of reliable teaching ideas and a baseline series for incorporating 
learning advances from emerging technologies. For example, we intend to 
reuse the kernel of each BC volume and add electronic scripts from other 
software programs as desired by customers. We are pursuing the addition 
of AI/Expert System technology to provide an intelligent tutoring capa- 
bility for future iterations of BC volumes. We also anticipate a paperless 
environment in which BC content can flow freely over high-speed net- 
works to support remote learning activities. In order for these and other 
goals to be realized, educators, students, software developers, network ad- 
ministrators, and publishers will need to communicate freely and actively 
with each other. We encourage you to participate in these exciting de- 
velopments and become involved in the BC Series today. If you have an 
idea for improving the effectiveness of the BC concept, an example prob- 
lem, a demonstration using software or multimedia, or an opportunity to 
explore, contact us. 

Thank you one and all for your continuing support. 
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Linear Predictive Coding (LPC) of Speech 401 i in computer technology and an explosion in user-friendly applications. 

This revolution is still continuing today with low-cost personal computer 
Dual-tone Multifrequency (DTMF) Signals 405 systems that rival the performance of expensive workstations. This tech- 
Binary Digital Communications 410 nological prowess should be brought to bear on the educational process 


and, in particular, on effective teaching that can result in enhanced learn- 


Spread-Spectrum Communications 411 ing. This companion book on digital signal processing (DSP) makes a 


Summary 413 small contribution toward that goal. 
The teaching methods in signal processing have changed over the 
BIBLIOGRAPHY 414 ; years from the simple “lecture-only” format to a more integrated “lecture- 


laboratory” environment in which practical hands-on issues are taught 
using DSP hardware. However, for effective teaching of DSP the lecture 
INDEX 415 component must also make extensive use of computer-based explanations, 
examples, and exercises. For the last several years, the MATLAB software 
developed by The MathWorks, Inc. has established itself as the de facto 
standard for numerical computation in the signal-processing community 
and as a platform of choice for algorithm development. There are sev- 
eral reasons for this development, but one most important reason is that 
MATLAB is available on practically all computing platforms. For several 
years the expensive Professional Version of MATLAB was the only version 
available on the market. The advent of an inexpensive Student Edition 
has now made it possible to use it in classrooms. Recently, several text- 
books in DSP have appeared which generally provide exercises that can 
be done using MATLAB. However, for students (and for practicing engi- 
neers interested in DSP) there are no “how-to” references for effective 
use of MATLAB in DSP. In this book we have made an attempt at inte- 
grating MATLAB with traditional topics in DSP so that it can be used 
to explore difficult topics and solve problems to gain insight. Many prob- 
lems or design algorithms in DSP require considerable computation. It is 
for these that MATLAB provides a convenient tool so that many scenar- 
ios can be tried with ease. Such an approach can enhance the learning 
j process. 
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SCOPE OF THE BOOK 


This book is primarily intended for use as a supplement in junior- or 
senior-level undergraduate courses on DSP. We assume that the student 
(or user) is familiar with the fundamentals of MATLAB. Those topics are 
not covered since several tutorial books and manuals on MATLAB are 
available. Similarly, this book is not written as a textbook in DSP because 
of the availability of excellent textbooks. What we have tried to do is to 
provide enough depth to the material augmented by MATLAB functions 
and examples so that the presentation is consistent, logical, and enjoyable. 
'Therefore this book can also be used as a self-study guide by anyone 
interested in DSP. 

When this project got under way, version 3.5 of the Student Edition of 
MATLAB was available. Since the beginning of 1995 a more advanced GUI 
(graphical user interface) version 4.0 of the Student Edition is available. 
This book is compatible with the newer version. 


ORGANIZATION OF THE BOOK 
IOS AGAR ARISCOHNE - MSEMEHUS 


The first eight chapters of this book discuss traditional material covered 
in an introductory course on DSP. The last two chapters are presented 
as applications in DSP with emphasis on MATLAB-based projects. The 
following is a list of chapters and a brief description of their contents: 


Chapter 1, Introduction: This chapter introduces readers to the disci- 
pline of signal processing and discusses the advantages of DSP over analog 
signal processing. A brief introduction to MATLAB is also provided. 

Chapter 2, Discrete-time Signals and Systems: This chapter provides 
a brief review of discrete-time signals and systems in the time domain. 
Appropriate use of MATLAB functions is demonstrated. 

. Chapter 3, The Discrete-time Fourier Analysis: This chapter dis- 
cusses discrete-time signal and system representation in the frequency 
domain. Sampling and reconstruction of analog signals are also presented. 

Chapter 4, The z-Transform: 'This chapter provides signal and sys- 
tem description in the complex frequency domain. MATLAB techniques are 
introduced to analyze z-transforms and to compute inverse z-transforms. 
Solutions of difference equations using the z-transform and MATLAB are 
provided. 

Chapter 5, The Discrete Fourier Transform: This chapter is devoted 
to the computation of the Fourier transform and to its efficient imple- 
mentation. The discrete Fourier series is used to introduce the discrete 
Fourier transform, and several of its properties are demonstrated using 
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MATLAB. Topics such as fast convolution and fast Fourier transform are 
thoroughly discussed. 

Chapter 6, Digital Filter Structures: This chapter discusses several 
structures for the implementation of digital filters. Several useful MATLAB 
functions are developed for the determination and implementation of these 
structures. Lattice and ladder filters are also introduced and discussed. 

Chapter 7, FIR Filter Design: This chapter and the next introduce 
the important topic of digital filter design. Three important design tech- 
niques for FIR filters — namely, window design, frequency sampling de- 
sign, and the equiripple filter design — are discussed. Several design ex- 
amples are provided using MATLAB. 

Chapter 8, IIR Filter Design: Included in this chapter are techniques 
in IIR filter design. It begins with analog filter design and introduces such 
topics as filter transformations and filter-band transformation. Once again 
several design examples using MATLAB are provided. 

Chapter 9, Applications in Adaptive Filtering: This chapter is the 
first of two chapters on projects using MATLAB. Included is an intro- 
duction to the theory and implementation of adaptive FIR filters with 
projects in system identification, interference suppression, narrowband 
frequency enhancement, and adaptive equalization. 

Chapter 10, Applications in Communications: This chapter focuses 
on several projects dealing with waveform representation and coding, and 
with digital communications. Included is a description of pulse-code mod- 
ulation (PCM), differential PCM (DPCM) and adaptive DPCM (AD- 
PCM), delta modulation (DM) and adaptive DM (ADM), linear predic- 
tive coding (LPC), generation and detection of dual-tone multifrequency 
(DTMF) signals, and a description of signal detection applications in bi- 
nary communications and spread-spectrum communications. 


The book is an outgrowth of our teaching of a MATLAB-based undergrad- 
uate DSP course over several years. Many MATLAB functions discussed in 
this book were developed in this course. These functions are available on 
the accompanying diskette as a pwsk_dsp toolbox. Create a separate di- 
rectory for this toolbox and reference it in the matlabpath environment. 
The book also contains numerous MATLAB scripts in many examples. 
These scripts are also made available on the disk and are kept in individ- 
ual directories created for each chapter. In addition, many figures were 
produced as MATLAB plots, and their scripts are available in the figures 
directory. Students should study these scripts to gain insight into the 
MATLAB procedures. We will appreciate any comments, corrections, or 
compact coding of these programs and scripts. Solutions to problems and 
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the associated script files will be made available to instructors in the near 
future. 

Further information about MATLAB and related publications may 
be obtained from 


The MathWorks, Inc. 

24 Prime Park Way 

Natick, MA 01760-1500 

Phone: (508) 647-7000 Fax: (508) 647-7001 
E-mail: info@mathworks.com 

WWW: http:/ /www.mathworks.com 
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PREFACE 


INTRODUCTION 





Over the past several decades the field of digital signal processing (DSP) 
has grown to be important both theoretically and technologically. A major 
reason for its success in industry is due to the development and use of low- 
cost software and hardware. New technologies and applications in various 
fields are now poised to take advantage of DSP algorithms. This will lead 
to a greater demand for electrical engineers with background in DSP. 
Therefore it is necessary to make DSP an integral part of any electrical 
engineering curriculum. 

Not long ago an introductory course on DSP was given mainly at 
the graduate level. It was supplemented by computer exercises on filter 
design, spectrum estimation, and related topics using mainframe (or mini) 
computers. However, considerable advances in personal computers and 
software over the past decade made it possible to introduce a DSP course 
to undergraduates. Since DSP applications are primarily algorithms that 
are implemented either on a DSP processor [11] or in software, a fair 
amount of programming is required. Using interactive software, such as 
MATLAB, it is now possible to place more emphasis on learning new and 
difficult concepts than on programming algorithms. Interesting practical 
examples can be discussed, and useful problems can be explored. 

With this philosophy in mind, we have developed this book as a com- 
panion book (to traditional textbooks like [16, 19]) in which MATLAB is 
an integral part in the discussion of topics and concepts. We have chosen 
MATLAB as the programming tool primarily because of its wide avail- 
ability on computing platforms in many universities across the country. 
Furthermore, a student edition of MATLAB has been available for several ` 
years, placing it among the least expensive software for educational pur- 
poses. We have treated MATLAB as a computational and programming 
toolbox containing several tools (sort of a super calculator with several 
keys) that can be used to explore and solve problems and, thereby, en- 
hance the learning process. 

This book is written at an introductory level in order to introduce 
undergraduate students to an exciting and practical field of DSP. We 
emphasize that this is not a textbook in the traditional sense but a 
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companion book in which more attention is given to problem solving and 
hands-on experience with MATLAB. Similarly, it is not a tutorial book 
in MATLAB. We assume that the student is familiar with MATLAB and is 
currently taking a course in DSP. The book provides basic analytical tools 
needed to process real-world signals (a.k.a. analog signals) using digital 
techniques. We deal mostly with discrete-time signals and systems, which 
are analyzed in both the time and the frequency domains. The analysis 
and design of processing structures called: filters and spectrum analyzers 
is one of the most important aspects of DSP and is treated in great detail 
in this book. Many advanced topics in DSP (which are generally covered 
in a graduate course) are not treated in this book, but it is hoped that 
the experience gained in this book will allow students to tackle advanced 
topics with greater ease and understanding. 

In this chapter we provide a brief overview of both DSP and MATLAB. 


OVERVIEW OF DIGITAL SIGNAL PROCESSING 
L——————————Mn— —— 


HOW ARE 
SIGNALS 
PROCESSED? 


In this modern world we are surrounded by all kinds of signals in vari- 
ous forms. Some of the signals are natural, but most of the signals are 
manmade. Some signals are necessary (speech), some are pleasant (mu- 
sic), while many are unwanted or unnecessary in a given situation. In an 
engineering context, signals are carriers of information, both useful and 
unwanted. Therefore extracting or enhancing the useful information from 
a mix of conflicting information is a simplest form of signal processing. 
More generally, signal processing is an operation designed for extracting, 
enhancing, storing, and transmitting useful information. 'The distinction 
between useful and unwanted information is often subjective as well as 
objective. Hence signal processing tends to be application dependent. 


The signals that we encounter in practice are mostly analog signals. These 
signals, which vary continuously in time and amplitude, are processed 
using electrical networks containing active and passive circuit elements. 
This approach is known as analog signal processing (ASP)—for example, 
radio and television receivers. 


Analog signal: zalt) —->] Analog signal processor | — ya(t) :Analog signal 


They can also be processed using digital hardware containing adders, 
multipliers, and logic elements or using special-purpose microprocessors. 
However, one needs to convert analog signals into a form suitable for 
digital hardware. This form of the signal is called a digital signal. It takes 
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ADVANTAGES 
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ASP 





one of the finite number of values at specific instances in time, and hence 
it can be represented by binary numbers, or bits. The processing of digital 
signals is called DSP; in block diagram form it is represented by 





Equivalent Analog Signal Processor 
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Discrete System 






where the various block elements are discussed below. 


PrF: This is a prefilter or an antialiasing filter, which conditions the 
analog signal to prevent aliasing. 

ADC: This is called an analog-to-digital converter, which produces a 
stream of binary numbers from analog signals. 

Digital signal processor: This is the heart of DSP and can represent a 
general-purpose computer or a special-purpose processor, or digital hard- 
ware, and so on. 

DAC: This is the inverse operation to the ADC, called a digital-to-analog 
converter, which produces a staircase waveform from a sequence of binary 
numbers, a first step towards producing an analog signal. 

PoF: This is a postfilter to smooth out staircase waveform into the de- 
sired analog signal. 


' It appears from the above two approaches to signal processing, analog 
and digital, that the DSP approach is the more complicated, containing 
more components than the “simpler looking” ASP. Therefore one might 
ask a question: Why process signals digitally? The answer lies in many 
advantages offered by DSP. 


A major drawback of ASP is its limited scope for performing complicated 
signal processing applications. This translates into nonflexibility in pro- 
cessing and complexity in system designs. All of these generally lead to 
expensive products. On the other hand, using a DSP approach, it is pos- 
sible to convert an inexpensive personal computer into a powerful signal 
processor. Some important advantages of DSP are these: 


1. Systems using the DSP approach can be developed using software 
running on a general-purpose computer. Therefore DSP is relatively con- 
venient to develop and test, and the software is portable. 

2. DSP operations are based solely on additions and multiplications, 
leading to extremely stable processing capability—for example, stability 
independent of temperature. 
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3. DSP operations can easily be modified in real time, often by simple 
programming changes, or by reloading of registers. 

4. DSP has lower cost due to VLSI technology, which reduces costs 
of memories, gates, microprocessors, and so forth. 


The principal disadvantage of DSP is the speed of operations, espe- 
cially at very high frequencies. Primarily due to the above advantages, 
DSP is now becoming a first choice in many technologies and applica- 
tions, such as consumer electronics, communications, wireless telephones, 
and medical imaging. 


Most DSP operations can be categorized as being either signal analysis 
tasks or signal filtering tasks as shown below. 









Digital signal 
Analysis i Digital filter 
Measurements Digital signal 


Signal analysis This task deals with the measurement of signal prop- 
erties. It is generally a frequency-domain operation. Some of its applica- 
tions are 


e spectrum (frequency and/or phase) analysis 
e speech recognition 

e speaker verification 

e target detection 


Signal filtering This task is characterized by the “signal in-signal out” 
situation. The systems that perform this task are generally called filters. 
It is usually (but not always) a time-domain operation. Some of the ap- 
plications are 


removal of unwanted background noise 
removal of interference 

separation of frequency bands 

shaping of the signal spectrum 
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In some applications, such as voice synthesis, à signal is first analyzed 
to study its characteristics, which are then used in digital filtering to 
generate a synthetic voice. 

In the first half of this book we will deal with the signal-analysis 
aspect of DSP. In Chapter 2 we will begin with basic descriptions of 
discrete-time signals and systems. These signals and systems are analyzed 
in the frequency domain in Chapter 3. A generalization of the frequency- 
domain description, called the z-transform, is introduced in Chapter 4. 
The practical algorithms for computing the Fourier transform are dis- 
cussed in Chapter 5 in the form of the discrete Fourier transform and the 
fast Fourier transform. 

The second half of this book is devoted to the signal-filtering aspect of 
DSP. In Chapter 6 we describe various implementations and structures of 
digital filters. In Chapter 7 we provide design techniques and algorithms 
for designing one type of digital filter called finite-duration impulse re- 
sponse (or FIR) filters, while in Chapter 8 we provide a similar treatment 
for another type of filter called infinite-duration impulse response (or IIR) 
filters. In both chapters we discuss only the simpler but practically use- 
ful techniques of filter design. More advanced techniques are not covered. 
Finally, the last two chapters provide some practical applications in the 
form of projects that can be done using material learned in the first eight 
chapters. In Chapter 9 concepts in adaptive filtering are introduced, and 
simple projects in system identification, interference suppression, adap- 
tive line enhancement, and so forth are discussed. In Chapter 10 a brief 
introduction to digital communications is presented with projects in such 
topics as PCM, DPCM, and LPC being outlined. 

In all these chapters the central theme is the generous use and ad- 
equate demonstration of MATLAB tools. Most of the existing MATLAB 
functions for DSP are described in detail, and their correct use is demon- 
strated in many examples. Furthermore, many new MATLAB functions are 
developed to provide insights into the working of many algorithms. We 
believe that this “hand-holding” approach will enable students to dispel 
fears about DSP and will provide an enriching learning experience. 


A FEW WORDS ABOUT MATLAB? 
A ——— —— ———— 


MATLAB is an interactive, matrix-based system for scientific and engi- 
neering numeric computation and visualization. Its strength lies in the 
fact that complex numerical problems can be solved easily and in a frac- 
tion of the time required with a programming language such as Fortran 
or C. It is also powerful in the sense that by using its relatively simple 
programming capability, MATLAB can be easily extended to create new 
commands and functions. 
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MATLAB is available on a number of computing environments: 
Sun/HP/VAXstation workstations, 80x86 PCs, Apple Macintosh, VAX, 
and several parallel machines. The basic MATLAB program is further 
enhanced by the availability of numerous toolboxes (a collection of spe- 
cialized functions in a specific topic) over the years. The information in 
this book generally applies to all these environments. The development 
of this book was begun under the professional version 3.5 running un- 
der DOS. A relatively inexpensive Student Edition containing limited 
toolboxes and functions was also available from Prentice Hall publishers. 
Therefore we decided to make MATLAB routines and other material in 
this book compatible with the Student Edition. However, at present the 
current major version of MATLAB is version 4.2 under graphical user 
interface (GUI). Also à new Student Edition in GUI is available since 
February 1995, containing enhanced and new toolboxes. This book is 
certainly compatible with this edition, and every attempt is made to 
identify the new functions that are available and that can be used. A new 
toolbox available in the Student Edition is the Symbolic toolbox, which is 
based on Maple engine. Since digital signal processing primarily requires 
numerical computations, the Symbolic toolbox is neither discussed nor 
used in this book. 

The scope and power of MATLAB go far beyond the few words given 
in this section. It is senseless to provide a concise information or tuto- 
rial on MATLAB when excellent books and guides are available on this 
topic. Students should consult the MATLAB User's Guide [2] and Refer- 
ence Guide [1]. Similarly, students should attempt the tutorial given in 
[3]. The information given in all these references, along with the online 
facility, usually is sufficient for students to use this book. 


Chapter 1 W INTRODUCTION 
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DISCRETE-TIME 
SIGNALS AND 
SYSTEMS 


We begin with the concepts of signals and systems in discrete time. A 
number of important types of signals and their operations are introduced. 
Linear and shift-invariant systems are discussed mostly because they are 
easier to analyze and implement. The convolution and the difference equa- 
tion representations are given special attention because of their impor- 
tance in digital signal processing and in MATLAB. The emphasis in this 
chapter is on the representations and implementation of signals and sys- 
tems using MATLAB. 


DISCRETE-TIME SIGNALS 


Signals are broadly classified into analog and discrete signals. An analog 
signal will be denoted by z4(#), in which the variable £ can represent any 
physical quantity, but we will assume that it represents time in seconds. A 
discrete signal will be denoted by z (n), in which the variable n is integer- 
valued and represents discrete instances in time. Therefore it is also called 
a discrete-time signal, which is a number sequence and will be denoted by 
one of the following notations: 


a(n) = (zm = {> 2 (71, 2(), 2(1), R 


where the up-arrow indicates the sample at n = 0. 

In MATLAB we can represent a finite-duration sequence by a row 
vector of appropriate values. However, such a vector does not have any 
information about sample position n. Therefore a correct representation 
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TYPES OF 
SEQUENCES 


of z(n) would require two vectors, one each for z and n. For example, a 
sequence x(n) = (2, 1, —1,0,1,4,3, 7) can be represented in MATLAB by 
T 


>> n*[-3,-2,-1,0,1,2,3,4]; x=[2,1,-1,0,1,4,3,7]; 


Generally, we will use the x-vector representation alone when the sample 
position information is not required or when such information is trivial 
(e.g. when the sequence begins at n = 0). An arbitrary infinite-duration 
sequence cannot be represented in MATLAB due to the finite memory 
limitations. 


We use several elementary sequences in digital signal processing for anal- 
ysis purposes. Their definitions and MATLAB representations are given 
below. 


1. Unit sample sequence: 


1, n=0_ i 
stn) = [à Ss oohoo} 


In MATLAB the function zeros(1,N) generates a row vector of N zeros, 
which can be used to implement 6(n) over a finite interval. However, the 
logical relation n==0 is an elegant way of implementing 6(n). For example, 
to implement 


1, n=n 
s(n —no) = [5 mis 


over the n; < no € nz interval, we will use the following MATLAB func- 
tion. 


function [x,n] = impseq(n0,ni,n2) 
% Generates x(n) = delta(n-n0); ni <= n <= n2 


% (x,n] = impseq(n0,ni,n2) 
X 
n = [ni:n2]; x = [(n-nO) == 0]; 


2. Unit step sequence: 


1, n20.- 
un) = {9 azg foo nna] 


In MATLAB the function ones(1,N) generates a row vector of N ones. It 


can be used to generate u(n) over a finite interval. Once again an elegant . 
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approach is to use the logical relation n>=0. To implement 


1, n2no 
n — no) = fi n < ng 


over the n; < ng < na interval, we will use the following MATLAB func- 
tion. 


function [x,n] = stepseq(n0,ni,n2) 
% Generates x(n) = u(n-n0); n1 <= n <= n2 


X (x,n] = stepseq(n0,n1,n2) 
n = [ni:n2]; x = [(n-n0) >= 0]; 
3. Real-valued exponential sequence: 
a(n) =a",Vn; a € R 
In MATLAB an array operator “.~” is required to implement a real ex- 


ponential sequence. For example, to generate z(n) = (0.9)^, 0 € n < 10, 
we will need the following MATLAB script: 


>> n = [0:10]; x = (0.9).^n; 

4. Complez-valued exponential sequence: 

x(n) = el tivo)n Yn 

where ø is called an attenuation and wọ is the frequency in radians. A 
MATLAB function exp is used to generate exponential sequences. For ex- 
ample, to generate z(n) = exp[(2--j3)n], 0 € n < 10, we will need 
the following MATLAB script: 
>> n = [0:10]; x = exp((2+3j)*n); 

5. Sinusoidal sequence: 

x(n) = cos(won + 8), Vn 

where 0 is the phase in radians. A MATLAB function cos (or sin) is 
used to generate sinusoidal sequences. For example, to generate x(n) = 
3cos(0.lan+7/3)+2sin(0.5an), 0 € n < 10, we will need the following 


MATLAB script: 


>> n = [0:10]; x = 3*cos(0.1*pitntpi/3) + 2*sin(0.5*pi*n); 
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6. Random sequences: Many practical sequences cannot be described 
by mathematical expressions like those above. These sequences are called 
random (or stochastic) sequences and are characterized by parameters of 
the associated probability density functions or their statistical moments. 
In MATLAB two types of (pseudo-) random sequences are available. The 
rand(1,N) generates a length N random sequence whose elements are 
uniformly distributed between [0, 1]. The randn(1,N) generates a length 
N Gaussian random sequence with mean 0 and variance 1. Other random 
sequences can be generated using transformations of the above functions. 

7. Periodic sequence: A sequence x(n) is periodic if x(n) = z(n-- N), 
Yn. The smallest integer N that satisfies the above relation is called the 
fundamental period. We will use z(n) to denote a periodic sequence. To 
generate P periods of z(n) from one period (z(n) 0€n € N — 1), we 
can copy z (n) P times: 


>> xtilde = [x,x,...,x]; 


But an elegant approach is to use MATLAB's powerful indexing capabili- 
ties. First we generate a matrix containing P rows of x(n) values. Then 
we can concatenate P rows into a long row vector using the construct 
(:). However, this construct works only on columns. Hence we will have 
to use the matrix transposition operator ’ to provide the same effect on 
rows. 


>> xtilde = x’ * ones(1,P); 4 P columns of x; x is a row vector 
>> xtilde = xtilde(:); % long column vector 
>> xtilde = xtilde’; X long row vector 


Note that the last two lines can be combined into one for compact coding. 
This is shown in Example 2.1. 


Here we briefly describe basic sequence operations and their MATLAB 
equivalents. 


1. Signal addition: This is a sample-by-sample addition given by 


{x1(n)} + (220) = {21 (n) + 22(0)] 


It is implemented in MATLAB by the arithmetic operator “+”. However, 
the lengths of zı (n) and x2(n) must be the same. If sequences are of 
unequal lengths, or if the sample positions are different for equal-length 
sequences, then we cannot directly use the operator +. We have to first 
augment z; (n) and z2 (n) so that they have the same position vector n 
(and hence the same length). This requires careful attention to MATLAB's 
indexing operations. In particular, logical operation of intersection “&”, 
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relational operations like “<=” and “==”, and the find function are re- 
quired to make x (n) and z» (n) of equal length. The following function, 
called the sigadd function, demonstrates these operations. 


function [y,n] = sigadd(xi,ni,x2,n2) 
% implements y(n) = xi(n)*x2(n) 


% [y,n] = sigadd(xi,n1,x2,n2) 

% y= sum sequence over n, which includes ni and n2 

% xi = first sequence over ni 

% x2 = second sequence over n2 (n2 can be different from nt) 


n = min(min(n1),min(n2)):max(max(ni),max(n2)); % duration of y(n) 
yi = zeros(1,length(n)); y2 = y1; % initialization 


yi (find ( (n>=min(n1))&(n<=max(n1))==1))=x1; % xi with duration of y 
y2(find ( (n>=min(n2))&(n<=max(n2))==1))=x2; % x2 with duration of y 
y = yity2; % sequence addition 


Its use is illustrated in Example 2.2. 
2. Signal multiplication: This is a sample-by-sample multiplication 
(or “dot” multiplication) given by 


{x1(n)} - (22(0)) = (1(0)22(0)) 


It is implemented in MATLAB by the array operator ".*". Once again 
the similar restrictions apply for the .* operator as for the * operator. 
Therefore we have developed the sigmult function, which is similar to 
the sigadd function. f 


function [y,n] = sigmult(x1,n1,x2,n2) 
% implements y(n) = xi(n)*x2(n) 


% [y,n] = sigmult(xi,ni,x2,n2) 

% y = product sequence over n, which includes ní and n2 

% xi = first sequence over ni 

% x2 = second sequence over n2 (n2 can be different from ni) 


n = min(min(n1),min(n2)):max(max(n1),max(n2)); % duration of y(n) 


yl = zeros(1,length(n)); y2 = yi; 4 
yi(find((n»-min(ni))&k(n«zmax(ni1))7-1))*x1; % xi with duration of y 
y2(find ((n>=min(n2) )&(n<=max(n2))==1))=x2;_ % x2 with duration of y 
y=yl .* y2; % sequence multiplication 


Its use is also given in Example 2.2. 
3. Scaling: In this operation each sample is multiplied by a scalar a. 


a (z(n)) = {az(n)} 


a 
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An arithmetic operator “*” is used to implement the scaling operation in 
MATLAB. 

4. Shifting: In this operation each sample of z(n) is shifted by an 
amount k to obtain a shifted sequence y(n). 


y(n) = {x(n — k)} 
If we let m = n — k, then n = m + k and the above operation is given by 
y (m k) = {z (m)) 


Hence this operation has no effect on the vector x, but the vector n 
is changed by adding k to each element. This is shown in the function 
sigshift. 


function [y,n] = sigshift(x,m,n0) 
% implements y(n) = x(n-n0) 


% [y,n] = sigshift (x,m,n0) 
n = mtn0; y = x; 
Its use is given in Example 2.2. 


5. Folding: In this operation each sample of x(n) is flipped around 
n = 0 to obtain a folded sequence y(n). 


y(n) = {z(—n)} 


In MATLAB this operation is implemented by fliplr (x) function for sam- 
ple values and by -fliplr(n) function for sample positions as shown in 
the sigfold function. 


function [y,n] = sigfold(x,n) 
% implements y(n) = x(-n) 


% fy,n] = sigfold(x,n) 


y = flipir(x); n = -flipir@); 
6. Sample summation: This operation differs from signal addition op- 
eration. It adds all sample values of x(n) between n; and nz. 


nz 


Z a(n) = z(ni) +- + z(n2) 


nzni 


It is implemented by the sum(x (n1:n2)) function. 








M 


o EXAMPLE 2.1 


Solution 





7. Sample products: This operation also differs from signal multipli- 
cation operation. It multiplies all sample values of z(n) between n; and 
N2- 


Tle) = 2(m) x--- x z(na) 


ni 


It is implemented by the prod (x (ni:n2)) function. 
8. Signal energy: The energy of a sequence z(n) is given by 


Ex =) 2(n)z*(n) = $ |e(n)? 


where superscript * denotes the operation of complex conjugation!. The 
energy of a finite-duration sequence x(n) can be computed in MATLAB 
using 


>> Ex = sum(x .* conj(x)); % one approach 
>> Ex = sum(abs(x) .^ 2); % another approach 


9. Signal power: The average power of a periodic sequence with fun- 
damental period N is given by 


Generate and plot each of the following sequences over the indicated interval. 
a. x(n) = 26(n--2) -6(n—-4) —5<n <5. 


b. z(n) = n [u(n) — u(n — 10)] + 10e 793719 [u(n — 10) — u(n — 20)], 
0 € n € 20. 
c. z(n) = cos(0.047) + 0.2w(n), 0 < n < 50, where w(n) is a Gaussian 
random sequence with zero mean and unit variance. 
d. $(n) = {...,5,4,3,2, 1,5, 4,3, 2, 1,5,4,3,2,1,...}; -10 < n < 9. 
T 


a. z(n) = 26(n--2) -6(n—-4),, -5<n<5. 
>> n = [-5:5]; 
>> x = 2*impseq(-2,-5,5) - impseq(4,-5,5); 
>> stem(n,x); title(’Sequence in Problem 2.1a’) 


>> xlabel(’n’); ylabel(’x(n)’); 


The plot of the sequence is shown in Figure 2.1a. 


1The symbol * denotes many operations in digital signal processing. Its font (roman 
or computer) and its position (normal or superscript) will distinguish each operation. 
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b. z(n) = n[u(n) — u(n — 10)] + 10e7°- 3-19) [u(n — 10) — u(n — 20)], 


O<n< 20. 


>> 
>> 
>> 
>> 
> 
>> 


v 


n = [0:20]; 

xi = n.*(stepseq(0,0,20)-stepseq(10,0,20)) ; 

x2 = 10*exp(-0.3*(n-10)) .*(stepseq(10,0,20)-stepseq(20,0,20)); 
x = x1+x2; 

subplot (2,2,3); stem(n,x); title(’Sequence in Problem 2.1b’) 
xlabel(’n’); ylabel(’x(n)’); 


The plot of the sequence is shown in Figure 2.1b. 


>> 
>> 
>> 
>> 


c. z(n) = cos(0.04zn) +0.2w(n), 0 <n <50. 


n = [0:50]; 

x = cos(0.04*pisn)40.2*randn(size(n)); 

subplot(2,2,2); stem(n,x); title('Sequence in Problem 2.1c*) 
xlabel(’n’); ylabel(’x(n)’); 


The plot of the sequence is shown in Figure 2.1c. 
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FIGURE 2.1 Sequences in Example 2.1 
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Solution 


d. ž(n) = {...,5, 4,3, 2, 1,5, 4,3, 2,1,5,4,3,2,1,..}; —10 <n < 9. 
T 


Note that over the given interval, the sequence £ (n) has four periods. 


>> n = (-10:9); x = [5,4,3,2,1]; 

>> xtilde = x’ * ones(1,4); 

>> xtilde = (xtilde(:))'; 

>> subplot (2,2,4); stem(n,xtilde); title(’Sequence in Problem 2.1da’) 
>> xlabel(’n’); ylabel(’xtilde(n)’); 


The plot of the sequence is shown in Figure 24d. o 


Let x(n) = {1,2,3,4,5,6, 7,6,5,4, 3,2,1}. Determine and plot the following 
sequences. i 


a. zi (n) = 2z(n — 5) — 3z (n + 4) 
b. z2 (n) = z(8— n) + z (n) z (n — 2) 


The sequence z (n) is nonzero over —2 X n < 10. Hence 
>> n = -2:10; x = [1:7,6:-1:1]; 


will generate x(n). 


a. zi (n) = 2z(n — 5) — 3z (n + 4). 
The first part is obtained by shifting x(n) by 5 and the second part by shift- 
ing r(n) by —4. This shifting and the addition can be easily done using the 
sigshift and the sigadd functions. 


>> [xii,nii] = sigshift(x,n,5); [x12,n12] = sigshift(r,n,-4); 

>> [xi,ni] = sigadd(2*x11,n11,-3*x12,n12); 

>> subplot(2,1,1); stem(ni,x1); title(’Sequence in Example 2.2a?) 
>> xlabel(’n’); ylabel(’x1(n)’); 


The plot of z1 (n) is shown in Figure 2.2a. 

b. x2 (n) = z (3 — n) + z (n) x (n - 2). 
The first term can be written as x (— (n — 3)). Hence it is obtained by first fold- 
ing x(n) and then shifting the result by 3. The second part is a multiplication 
of x(n) and z (n — 2), both of which have the same length but different support 
(or sample positions). These operations can be easily done using the sigfold 
and the sigmult functions. 


>> [x21,n21] = sigfold(x,n); [x21,n21] = sigshift(x21,n21,3); 

>> [x22,n22] = sigshift(x,n,2); [x22,n22] = sigmult(x,n,x22,n22); 
>> [x2,n2] = sigadd (x21 ,n21,x22,n22); 

>> subplot(2,1,2); stem(n2,x2); title(’Sequence in Example 2.2b’) 
>> xlabel(’n’); ylabel(’x2(n)’); 


The plot of z2 (n) is shown in Figure 2.2b. n 
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FIGURE 2.2 Sequences in Example 2.2 


This example shows that the four sig* functions developed in this 
section provide a convenient approach for sequence manipulations. 


Generate the complex-valued signal 
2(n) = ef-01490-3)" 19 <n < 10 


and plot its magnitude, phase, the real part, and the imaginary part in four 
separate subplots. 


MATLAB Script _—_- LLL ——————————— 


>> n = [-10:1:10]; alpha = -0.1+0.3j; 

>> x = exp(alpha*n) ; 

>> subplot (2,2,1); stem(n,real(x));title(’real part’) ;xlabel(’n’) 

>> subplot(2,2,2); stem(n, imag(x)) ;title(’ imaginary part’) ;xlabel(’n’) 

>> subplot (2,2,3); stem(n,abs(x)) ;title(’magnitude part’) ;xlabel(’n’) 

>> subplot(2,2,4); stem(n, (180/pi)*angle(x)) ;title(’ phase part’) ;xlabel(’n’) 
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The plot of the sequence is shown in Figure 2.3. n 
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FIGURE 2.3 Complez-valued sequence plots in Example 2.3 


There are several important results in discrete-time signal theory. We will 
discuss some that are useful in digital signal processing. 


Unit sample synthesis Any arbitrary sequence x(n) can be synthe- 
sized as a weighted sum of delayed and scaled unit sample sequences, such 
as 


a(n)= Y; 2(k)6(n—k) (2.1) 


=— oo 


We will use this result in the next section. 


Even and odd synthesis A real-valued sequence ze(n) is called even 
(symmetric) if 


Le(—n) = ze(n) 
Similarly, a real-valued sequence 2,(7) is called odd (antisymmetric) if 


zo(—n) = —zo(n) 


a 
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Then any arbitrary real-valued sequence z(n) can be decomposed into its 
even and odd components 


a(n) = a(n) + zo(n) (2.2) 


where the even and odd parts are given by 
Teln) = 3 [r(n)- z(-n) and 2,(n)= : lz(n)-z(-n)) Q3) 


respectively. We will use this decomposition in studying properties of the 
Fourier transform. Therefore it is a good exercise to develop a simple 
MATLAB function to decompose a given sequence into its even and odd 
components. Using MATLAB operations discussed so far, we can obtain 
the following evenodd function. 


function [xe, xo, m] = evenodd(x,n) 
% Real signal decomposition into even and odd parts 


% [xe, xo, m] = evenodd(x,n) 
X 
if any(imag(x) “= 0) 
error(’x is not a real sequence’) 
end 
m = -fliplr(n); 
mi = min([m,n]); m2 = max({m,n]); m = mi:m2; 
nm = n(1)-m(1); ni = 1:length(n); 
xi = zeros(1,length(m)); 
xi(ni*nm) = x; x = xi; 
xe = 0.5*(x + fliplr(x); 
xo = 0.5*(x - fliplr(x)); 


The sequence and its support are supplied in x and n arrays, respectively. 
It first checks if the given sequence is real and determines the support 
of the even and odd components in m array. It then implements (2.3) 
with special attention to the MATLAB indexing operation. 'The resulting 
components are stored in xe and xo arrays. 


Let x(n) = u(n) — u(n — 10). Decompose x(n) into even and odd components. 


The sequence z(n), which is nonzero over 0 < n < 9, is called a rectangular 
pulse. We will use MATLAB to determine and plot its even and odd parts. 


>> n = [0:10]; x = stepseq(0,0,10)-stepseq(10,0,10); 

>> [xe,xo,m] = evenodd(x,n); 

>> figure(1); clf 

>> subplot(2,2,1); stem(n,x); title( Rectangular pulse?) 
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>> xlabel(n?); ylabel(’x(n)’); axis([-10,10,0,1.2]) 

>> subplot(2,2,2); stem(m,xe); title(’Even Part’) 

>> xlabel(’n’); ylabel(’xe(n)’); axis([-10,10,0,1.2]) 
»» subplot(2,2,4); stem(m,xo); title(’Odd Part’) 

>> xlabel(’n’); ylabel(’xe(n)’); axis([-10,10,-0.6,0.6]) 


The plots shown in Figure 2.4 clearly demonstrate the decomposition. o 


A similar decomposition for complex-valued sequences is explored in 


Problem 2.5. 


The geometric series A one-sided exponential sequence of the form 
(o^, n> 0], where a is an arbitrary constant, is called a geometric 
series. In digital signal processing, the convergence and expression for the 
sum of this series are used in many applications. The series converges for 
|| < 1, while the sum of its components converges to 


oo 


n=0 


Rectangular pulse 





a ae 


Ye dz for lo| < 1 (2.4) 
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FIGURE 2.4 Even-odd decomposition in Ezample 2.4 
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We will also need an expression for the sum of any finite number of terms 
of the series given by 


N-1 N 
n_ l-a 
X a” = pv (2.5) 


n=0 





These two results will be used throughout this book. 


Correlations of sequences Correlation is an operation used in many 
applications in digital signal processing. It is a measure of the degree to 
which two sequences are similar. Given two real-valued sequences a(n) and 
y(n) of finite energy, the crosscorrelation of x(n) and y(n) is a sequence 
Tzy(£) defined as 


oo 


rs) -. Y, z(n)y(n- 0 (2.6) 


n=—00 


The index @ is called the shift or lag parameter. The special case of (2.6) 
when y(n) = x(n) is called autocorrelation and is defined by 


oo 


rss) = X 2(n)2(n— 4) (2.7) 


n=~00 


It provides a measure of self-similarity between different alignments of the 
sequence. MATLAB functions to compute auto- and crosscorrelations are 
discussed later in the chapter. 


DISCRETE SYSTEMS 


LINEAR 
SYSTEMS 


Mathematically, a discrete-time system (or discrete system for short) is 
described as an operator TT that takes a sequence z(n) (called excitation) 
and transforms it into another sequence y(n) (called response). That is, 


y(n) = Tlz(n)) 


In DSP we will say that the system processes an input signal into an output 
signal. Discrete systems are broadly classified into linear and nonlinear 
systems. We will deal mostly with linear systems. 


A discrete system T'[.] is a linear operator L|] if and only if L['] satisfies 
the principle of superposition, namely, 
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L|oxzi(n) + a2z2(n)) = a Lfe: (n)] + a2L[za(n)], Var, a2, 21(n), x(n) 
(2.8) 


Using (2.1) and (2.8), the output y (n) of a linear system to an arbitrary 
input x(n) is given by j 


TE Y TIE = Y s()Lpn- E) 


n--—oo "-—-—oo 


The response L [6 (n — k)| can be interpreted as the response of a linear 
system at time n due to a unit sample (a well-known sequence) at time k. 
It is called an impulse response and is denoted by h(n, k). The output 
then is given by the superposition summation 


oo 


y(n) 2 >> z(K)h(n,k) (2.9) 


n=-0 


The computation of (2.9) requires the time-varying impulse response 
h(n,k), which in practice is not very convenient. Therefore time-invariant 
systems are widely used in DSP. 


Linear time-invariant (LTI) system A linear system in which an 
input-output pair, z(n) and y(n), is invariant to a shift n in time is called ` 
a linear time-invariant system. For an LTI system the L[.] and the shifting 
operators are reversible as shown below. 


z(n) — [E] — y(n) — [Shift by k| — y(n — x) 
z(n) — [Shift by k| — x(n - 9 — [1] — v - € 


We will denote an LTI system by the operator LTJ(-]. Let x(n) and y(n) 
be the input-output pair of an LTI system. Then the time-varying function 
h (n, k) becomes a time-invariant function h (n — k), and the output from 
(2.9) is given by 


oo 


y(n) = LTI [e(n] = Y, z(K)h(n- k) (2.10) 


k--—oo 


The impulse response of an LTI system is given by h(n). The mathemat- 
ical operation in (2.10) is called a linear convolution sum and is denoted 
by 


y(n) Ê z(n) * h(n) (2.11) 
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Hence an LTI system is completely characterized in the time domain by 
the impulse response h(n) as shown below. 


x(n) — [Atm] — v) = a(n) + h(n) 


We will explore several properties of the convolution in Problem 2.12. 


Stability This is a very important concept in linear system theory. The 
primary reason for considering stability is to avoid building harmful sys- 
tems or to avoid burnout or saturation in the system operation. A system 
is said to be bounded-input bounded-output (BIBO) stable if every bounded 
input produces a bounded output. 


Iz(n)] < oo = |y(n)| < oo. Yz, y 


An LTI system is BIBO stable if and only if its impulse response is abso- 
lutely summable. 


BIBO Stability += J_ |h(n)| < oo (2.12) 


=00 


Causality This important concept is necessary to make sure that sys- 
tems can be built. A system is said to be causal if the output at index no 
depends only on the input up to and including the index no; that is, the 
output does not depend on the future values of the input. An LTI system 
is causal if and only if the impulse response 


h(n) 20, n<0 (2.13) 


Such a sequence is termed a causal sequence. In signal processing, unless 
otherwise stated, we will always assume that the system is causal. 


CONVOLUTION 


2 


We introduced the convolution operation (2.11) to describe the response 
of an LTI system. In DSP it is an important operation and has many other 
uses that we will see throughout this book. Convolution can be evaluated 
in many different ways. If the sequences are mathematical functions (of 
finite or infinite duration), then we can analytically evaluate (2.11) for all 
n to obtain a functional form of y(n). 
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a EXAMPLE 2.5 


Solution 


CASE i 


Let the rectangular pulse x(n) = u(n) — u(n — 10) of Example 2.4 be an input 
to an LTI system with impulse response 


h(n) = (0.9)" u(n) 


Determine the output y(n). 


The input z(n) and the impulse response h(n) are shown in Figure 2.5. From 
(2.11) 


9 9 
y(n) = Y 0) (0.9) u(n - k) = (0.9)" Y @.9)*u(n—k) (Q4 
k=0 k=0 


The sum in 2.14 is almost a geometric series sum except that the term u(n — k) 
takes different values depending on n and k. There are three different conditions 
under which u(n — k) can be evaluated. 


n <0: Then u(n—k) 20, 0< k <9. Hence from (2.14) 
y(n) 20 (2.15) 


In this case the nonzero values of z(n) and h(n) do not overlap. 





x(n) 





h(n) 





FIGURE 2.5 The input sequence and the impulse response in Example 2.5 
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Convolution 


CASE ii 


CASE iii 


o EXAMPLE 2.6 


0< n <9: Then u(n—k) 21, 0< k <n. Hence from (2.14) 
- n - r n E k 
y(n)= (0.9)" V 7 (0.9) = (0.9) X [(0.9)7*) (2.16) 
k-0 k=0 
a 1- (0.9) 0*9 
1- (0.9)! 

In this case the impulse response h(n) partially overlaps the input x(n). 
n 2 9: Then u(n — k) = 1, 0 < k € 9 and from (2.14) 


- (0.9) =10[1-(0.9)"""], O<n<9 


9 
y(n)= (0.9)" $ (0.9)~* (2.17) 
iè (0.9) ?9 
1 — (0.9)? 


In this last case h(n) completely overlaps x(n). 


= (0.9)" 





10(0.9)""° [1 — (0.9)°], n>9 


The complete response is given by (2.15), (2.16), and (2.17). It is shown in 
Figure 2.6 which depicts the distortion of the input pulse. n 


The above example can also be done using a method called graphical 
convolution, in which (2.11) is given a graphical interpretation. In this 
method h(n — k) is interpreted as a folded-and-shifted version of h(k). 
The output y(n) is obtained as a sample sum under the overlap of z(k) 
and h(n — k). We use an example to illustrate this. 


Given the following two sequences 


x(n) = m , —-3E€n&3 h(n) = ED -5,2,1| , -l<n<4 
1 t 
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determine the convolution y(n) = x(n) * h(n). 


In Figure 2.7 we show four plots. The top-left plot shows z(k) and h(k), the 
original sequences. The top-right plot shows x(k) and h(—k), the folded version 
Output Sequence 
8 T pue T Te] paes pe: 
6 
$4 
2 
0 
-5 0 5 10 15 20 25 30 35 40 45 
n 


FIGURE 2.6 The output sequence in Example 2.5 
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x(k) and h(k) x(k) and h(-k) 
10 solid: x dashed: 
5 
o 
o 
SIEBEN 
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x(k) and h(-1-k) 


x(k) and h(2-k) 
solid: x dashed: 














solid: x dashed: 





10) 10 
5 5 
0 9 : $ n=2 
5 -5 ò 
-5 0 5 5 0 5 
k k 


FIGURE 2.7 Graphical convolution in Example 2.6 


of h(k). The bottom-left plot shows z(k) and h(—1 — k), the folded-and-shifted- 
by-—1 version of h(k). Then 


Y= a(k)a(-1 — k) = 3 x (—5) + 11 x047x340x226-y(-1) 
k 
The bottom-right plot shows z(k) and h(2 — k), the folded-and-shifted-by-2 
version of h(k), which gives 


yos(9h(2- 5) = 11x 17x 240% (5) + (CD xO+4x 3422 = 41 = y(2) 
k 


Thus we have obtained two values of y(n). Similar graphical calculations can 
be done for other remaining values of y(n). Note that the beginning point (first 
nonzero sample) of y(n) is given by n = —3 + (-1) = —4 while the end point 
(the last nonzero sample) is given by n = 3 +4 = 7. The complete output is 
given by 


y(n) = fe, 31, 47,6, —51, —5, 41, 18, —22, —3, 8, 2} 
t 


Students are strongly encouraged to verify the above result. Note that the result- 
ing sequence y (n) has a longer length than both the z (n) and h (n) sequences. 
o 


If arbitrary sequences are of infinite duration, then MATLAB cannot be 
used directly to compute the convolution. MATLAB does provide a built-in 
function called conv that computes the convolution between two finite- 


NENNEN ee 
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(m) EXAMPLE 2.7 


Solution 
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duration sequences. The conv function assumes that the two sequences 
begin at n = 0 and is invoked by 


>> y = conv(x,h); 
For example, to do the convolution in Example 2.5, we could use 


>> x = [3, 11, 7, 0, -1, 4, 2]; 
>> h = [2, 3, 0, -5, 2, 1); 
>> y = conv(x,h) 
y= 
6 31 47 6 -51 -5 41 18 -22 -8 8 2 


to obtain the correct y(n) values. However, the conv function neither pro- 
vides nor accepts any timing information if the sequences have arbitrary 
support. What is needed is a beginning point and an end point of y(n). 
Given finite duration z(n) and h(n), it is easy to determine these points. 
Let 


(z(n; neb n € n4) and (h(n) nu <N < Nae} 


be two finite-duration sequences. Then referring to Example 2.6 we ob- 
serve that the beginning and end points of y(n) are 


Nyb — nap ap aNd Nye = Nze + nhe 


respectively. A simple extension of the conv function, called conv.m, which 
performs the convolution of arbitrary support sequences can now be de- 
signed. 


function [y,ny] = conv_m(x,nx,h,nh) 
% Modified convolution routine for signal processing 


% Cy ny] = conv_m(x,nx,h,nh) 

% f{y,ny] = convolution result 

% [x,nx] = first signal 

% [h,nh] = second signal 

p 

nyb = nx(1)*nh(1); nye = nx(length(x)) + nh(length(h)); 
ny = [nyb:nyel; 

y = conv(x,h); 


Perform the convolution in Example 2.6 using the conv_m function. 
MATLAB Script 


>> x = (3, 11, 7, 0, -1, 4, 2); nx = (-3:3]; 
>> h = [2, 3, 0, -5, 2, 1]; ny = [-1:4]; 
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CORRE- 
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o EXAMPLE 2.8 


Solution 


>> [y,ny] = conv_m(x,nx,h,nh) 
y= 
6 31 47 6 -51 -5 41 18 -22 -3 8 2 


y(n) = fe, 31, 47,6, —51, —5, 41, 18, —22, —3, 8, 2 
T 
as in Example 2.6. o 


An alternate method in MATLAB can be used to perform the convo- 
lution. This method uses a matrix-vector multiplication approach, which 
we will explore in Problem 2.13. 


If we compare the convolution operation (2.11) with that of the crosscor- 
relation of two sequences defined in (2.6), we observe a close resemblance. 
The crosscorrelation ryz(¢) can be put in the form 


rys(£) = y(£) * x(—4) 
with the autocorrelation rzz(é) in the form 
Tas (£) = (£) * z(—£) 


Therefore these correlations can be computed using the conv function if 
sequences are of finite duration. 


In this example we will demonstrate one application of the crosscorrelation 
sequence. Let 


z(n)- |s. 11,7,0, 1,42] 
1 


be a prototype sequence, and let y(n) be its noise-corrupted-and-shifted version 
y(n) = a(n - 2) + w(n) 


where w(n) is Gaussian sequence with mean 0 and variance 1. Compute the 
crosscorrelation between y(n) and z(n). 


From the construction of y(n) it follows that y(n) is “similar” to z(n — 2) and 
hence their crosscorrelation would show the strongest similarity at £ = 2. To test 
this out using MATLAB, let us compute the crosscorrelation using two different 
noise sequences. 


Sisto nn 
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% noise sequence i 


>> 
>> 


>> 


* 


x= [3, 11, 7, 0, -1, 4, 2]; nx=[-3:3]; % given signal x(n) 


[y ny] = sigshift(x,nx,2); % obtain x(n-2) 

w = randn(i,length(y)); nw = ny; % generate w(n) 

fy, ny] = sigadd(y,ny,w,nw); % obtain y(n) = x(n-2) + w(n) 
[x,nx] = sigfold(x,nx); % obtain x(-n) 

[rxy,nrxy] = conv. m(y,ny,rx,nx); % crosscorrelation 


subplot(1,1,1), subplot(2,1,1);stem(nrxy,rry) 
axis([-5,10,-50,250]);xlabel('lag variable 1’) 
ylabel(’rxy’) ;title(’Crosscorrelation: noise sequence 1’) 


% noise sequence 2 


x = [3, 11, 7, 0, -1, 4, 2]; nx-[-3:3]; % given signal x(n) 

[y, ny] = sigshift(x,nx,2); % obtain x(n-2) 

w = randn(1,length(y)); nw = ny; % generate w(n) 

[y,ny] = sigadd(y,ny,w,nw); % obtain y(n) = x(n-2) + w(n) 
(x,nx] = sigfold(x,nx); % obtain x(-n) 

[rxy,nrxy] = conv n(y,ny,x,nx); % crosscorrelation 


Subplot(2,1,2);stem(nrxy,rxy) 
axis([-5,10,-50,250]);xlabel('lag variable 1’) 
ylabel(’rxy’);title(’Crosscorrelation: noise sequence 2’) 


From Figure 2.8 we observe that the crosscorrelation indeed peaks at £ = 2, 
which implies that y (n) is similar to z (n) shifted by 2. This approach can be 


Crosscorrelation: noise sequence 1 


200r Maximum 


-50 
-4 -2 0 2 4 6 8 
lag variable | 


Crosscorrelation: noise sequence 2 


Maximum 











2 
lag variable 1 


FIGURE 2.8 Crosscorrelation sequence with two different noise realizations 
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Difference Equations 


used in applications like radar signal processing in identifying and localizing 
targets. a 


It should be noted that the signal-processing toolbox in MATLAB also 
provides a function called xcorr for sequence correlation computations. 
In its simplest form 


»» xcorr(x,y) 
computes the crosscorrelation between vectors x and y, while 
»» xcorr(x) 


computes the autocorrelation of vector x. This function is not available in 
the Student Edition of MATLAB. It generates results that are identical to 
the one obtained from the proper use of the conv.m function. However, the 
xcorr function cannot provide the timing (or lag) information (as done by 
the conv.m function), which then must be obtained by some other means. 
Therefore we will emphasize the use of the conv.m function. 


DIFFERENCE EQUATIONS 


An LTI discrete system can also be described by a linear constant coeffi- 
cient difference equation of the form 


N M 
Y asyn -k)= 25 b,x(n— m), Vn (2.18) 
k=0 


m=0 


If ay # 0, then the difference equation is of order N. This equation 
describes a recursive approach for computing the current output, given 
the input values and previously computed output values. In practice this 
equation is computed forward in time, from n = —oo to n = oo. Therefore 
another form of this equation is 


M N 
(n) = Y msln- m) - 3 au(n - k) (219) 
m=0 k=1 
A solution to this equation can be obtained in the form 

y(n) = yaln) + yp(n) 
The homogeneous part of the solution, yy (n), is given by 


N 
yu(n) = D> czk 


k=1 
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TATION 


(2) EXAMPLE 2.9 


Solution 


where zy, k = 1,..., N are N roots (also called natural frequencies) of the 
Characteristic equation 


This characteristic equation is important in determining the stability of 
systems. If the roots zę satisfy the condition 


Iz <1, K=1,...,N (2.20) 
then a causal system described by (2.19) is stable. The particular part 
of the solution, yp(n), is determined from the right-hand side of (2.18). 


In Chapter 4 we will discuss the analytical approach of solving difference 
equations using the z-transform. 


A routine called filter is available to solve difference equations numeri- 
cally, given the input and the difference equation coefficients. In its sim- 
plest form this routine is invoked by 


y = filter(b,a,x) 

where 

b = [bO, bi, ..., DM]; a= [a0, al, ..., aN]; 

are the coefficient arrays from the equation given in (2.18), and x is the 
input sequence array. The output y has the same length as input x. One 


must ensure that the coefficient a0 not be zero. We illustrate the use of 
this routine in the following example. 


Given the following difference equation 
y(n) — y(n - 1) -0.9y(n - 2) = s(n); Vn 
a. Calculate and plot the impulse response h(n) at n = —20,..., 100. 


b. Calculate and plot the unit step response s(n) at n = —20,..., 100. 
c. Is the system specified by h(n) stable? 


From the given difference equation the coefficient arrays are 


b= [1]; a=[1, -1, 0.9]; 
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a. MATLAB Script 
>> b = [i]; a= (1, -1, 0.9); 
>> x = impseq(0,-20,120); n = [-20:120]; 
>> h = filter(b,a,x); 
>> subplot(2,1,1); stem(n,h); 
>> title('Impulse Response’); xlabel(’n’); ylabel(’h(n)’) 


The plot of the impulse response is shown in Figure 2.9. 
b. MATLAB Script 
>> x = stepseq(0,-20,120); 
>> s = filter(b,a,x); 
»» subplot(2,1,2); stem(n,s) 
>> title('Step Response’); xlabel(’n’); ylabel(’s(n)’) 


The plot of the unit step response is shown in Figure 2.9. 

c. To determine the stability of the system, we have to determine h(n) for 
all n. Although we have not described a method to solve the difference equation, 
we can use the plot of the impulse response to observe that h(n) is practically 
zero for n > 120. Hence the sum $7 |h(n)| can be determined from MATLAB 
using 


Impulse Response 

















FIGURE 2.9 Impulse response and step response plots in Example 2.9 





O EXAMPLE 2.10 


3 


>> sum(abs(h)) 
ans = 14.8785 


which implies that the system is stable. An alternate approach is to use the 
stability condition (2.20) using MATLAB's roots function. 


»»z = roots(a); 
>>magz = abs(z) 
magz = 0.9487 

0.9487 


Since the magnitudes of both roots are less than one, the system is stable. D 


In the previous section we noted that if one or both sequences in 
the convolution are of infinite length, then the conv function cannot be 
used. If one of the sequences is of infinite length, then it is possible to use 
MATLAB for numerical evaluation of the convolution. This is done using 
the filter function as we will see in the following example. 


Let us consider the convolution given in Example 2.5. The input sequence is of 
finite duration 
z(n) = u(n) — u(n — 10) 
while the impulse response is of infinite duration 
h(n) = (0.9)" u(n) 
Determine y(n) = x(n) * h(n). 
If the LTI system, given by the impulse response h(n), can be described by a 


difference equation, then y(n) can be obtained from the filter function. From 
the h(n) expression 


(0.9) h(n — 1) = (0.9) (0.9)"? u(n — 1) = (0.9)" u(n — 1) 
or 
h(n) — (0.9) h(n — 1) = (0.9)" u(n) — (0.9)" u(n — 1) 
= (0.9)" [u(n) — u(n — 1)] = (0.9)" &(n) 
= é(n) 


The last step follows from the fact that ó(n) is nonzero only at n — 0. By 
definition h(n) is the output of an LTI system when the input is 6(n). Hence 
substituting x(n) for 6(n) and y(n) for h(n), the difference equation is 


y(n) - 0.9y(n — 1) = x(n) 


Now MATLAB's filter function can be used to compute the convolution indi- 
rectly. 
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FIGURE 2.10 Output sequence in Example 2.10 


>> b= [1]; a = [1,-0.9]; 

>> n = -5:50; x = stepseq(0,-5,50) - stepseq(10,-5,50); 
>> y = filter(b,a,x); 

>> subplot(1,1,1); 

>> subplot(2,1,2); stem(n,y); titleC Output sequence?) 
>> xlabel(’n’); ylabel C y(n)’); axis([-5,50,-0.5,8]) 


The plot of the output is shown in Figure 2.10, which is exactly the same as 
that in Figure 2.6. n 


In Example 2.10 the impulse response was a one-sided exponential se- 
quence for which we could determine a difference equation representation. 
This means that not all infinite-length impulse responses can be converted 
into difference equations. The above analysis, however, can be extended to 
a linear combination of one-sided exponential sequences, which results in 
higher-order difference equations. We will discuss this topic of conversion 
from one representation to another one in Chapter 4. 


In digital signal processing the difference equation is generally solved for- 
ward in time from n = 0. Therefore initial conditions on x(n) and y(n) 
are necessary to determine the output for n > 0. The difference equation 
is then given by 


M N 
y(n) =Y bma(n—m)—Sray(n—k);n20 (221) 
k=1 


m=0 
subject to the initial conditions: 

(yn -_N<n<-l} and  (z(n; -M<ns -1) 
A solution to (2.21) can be obtained in the form 


y(n) = yzi(n) + vzs(n) 


DIGITAL 
FILTERS 


where yzj(n) is called the zero-input solution, which is a solution due 
to the initial conditions alone (assuming they exist), while the zero-state 
solution, yzs(n), is a solution due to input z(n) alone (or assuming that 
the initial conditions are zero). In MATLAB another form of the function 
filter can be used to solve for the difference equation, given its initial 
conditions. We will illustrate the use of this form in Chapter 4. 


Filter is a generic name that means a linear time-invariant system de- 
signed for a specific job of frequency selection or frequency discrimination. 
Hence discrete-time LTI systems are also called digital filters. There are 
two types of digital filters. 


FIR filter If the unit impulse response of an LTI system is of finite 
duration, then the system is called a finite-duration impulse response (or 
FIR) filter. Hence for an FIR filter h(n) = 0 for n « n; and for n > n2. 
The following part of the difference equation (2.18) describes a causal FIR 
filter: 


M 
y(n) = Y, bmz(n — m) (2.22) 


m=0 


Furthermore, h(0) = bo, h(1) = 1, ..., h(M) = bm, while all other h(n)’s 
are 0. FIR filters are also called nonrecursive or moving average (MA) 
filters. In MATLAB FIR filters are represented either as impulse response 
values {h(n)} or as difference equation coefficients {bm} and {ao = 1}. 
Therefore to implement FIR filters, we can use either the conv(x,h) 
function (and its modifications that we discussed) or the filter (b,1,x) 
function. There is a difference in the outputs of these two implementations 
that should be noted. The output sequence from the conv(x,h) function 
has a longer length than both the x(n) and h(n) sequences. On the other 
hand, the output sequence from the filter(b,1 ,X) function has exactly 
the same length as the input x(n) sequence. In practice (and especially 
for processing signals) the use of the filter function is encouraged. 


IIR filter If the impulse response of an LTI system is of infinite dura- 
tion, then the system is called an infinite-duration impulse response (or 
IIR) filter. The following part of the difference equation (2.18): 


N 
So axy(n — k) = z(n) (2.23) 


k=0 


describes a recursive filter in which the output y(n) is recursively com- 
puted from its previously computed values and is called an autoregressive 
(AR) filter. The impulse response of such filter is of infinite duration and 
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hence it represents an IIR filter. The general equation (2.18) also describes 
an IIR filter. It has two parts: an AR part and an MA part. Such an IIR 
filter is called an autoregressive moving average, or an ARMA, filter. In 
MATLAB IIR filters are described by the difference equation coefficients 
{bm} and {ax} and are implemented by the filter(b,a,x) function. 


PROBLEMS 


P2.2 


P2.3 


P2.4 


Generate and plot the samples (use the stem function) of the following sequences using 
MATLAB. 


a. zi (n) = 3229 a (m 1)l6(n - 2m) -6(n-2m -1], 0<n <25. 
b. za(n) = n? [u(n + 5) — u(n — 6)] + 106(n) + 20(0.5)" [u(n — 4) — u(n — 10)]. 
c. zs (n) = (0.9)" cos (0.2rn + 7/3), 0€n <20. 


d. z4(n) = 10cos(0.0008z?) + w(n), 0 € n € 100, where w(n) is a random sequence 
uniformly distributed between [1,1]. How do you characterize this sequence? 


e. Zs(n) = {..., 1,2,3,2, 1,2,3,2, 1,. . .) PERIODIC. Plot 5 periods. 
T 


Let z(n) = (1, —2,4,6, —5,8, 10). Generate and plot the samples (use the stem function) of 
the following sequences. : 

a. zi (n) = 3z(n + 2) + x(n — 4) - 2z(n) 

b. z2 (n) = 5z(5 + n) + Az(n + 4) + 3z(n) 

c. x3 (n) = z(n + 4)z(n — 1) + z(2 — n)x(n) 

d. z4 (n) = 2e) 5^ (n) + cos (0.1mn) x (n +2), -10 < n € 10 

e. zs (n) = Jos, nz (n — k) 

The complex exponential sequence e’“°” or the sinusoidal sequence cos (won) are periodic if 
the normalized frequency fo & x is a rational number; that is, fo = N’ where K and N 
are integers. 

a. Prove the above result. 


b. Generate and plot cos(0.3mn), —20 < n < 20. Is this sequence periodic? If it is, what is 
its fundamental period? From the examination of the plot what interpretation can you give 
to the integers K and N above? 


c. Generate and plot cos(0.3n), —20 < n < 20. Is this sequence periodic? What do you 
conclude from the plot? If necessary examine the values of the sequence in MATLAB to 
arrive at your answer. 


Decompose the sequences given in Problem 2.2 into their even and odd components. Plot 
these components using the stem function. 


A complex-valued sequence z,(n) is called conjugate-symmetric if 


ze (n) = zz (—n) 


e M ——— 


Problems 35 


P2.6 





Similarly, a complex-valued sequence zo (n) is called conjugate-antisymmetric if 
Zo(n) = —2(—n) 
Then any arbitrary complex-valued sequence z(n) can be decomposed into 
a(n) = re(n) + zo(n) 


where z-(n) and x(n) are given by 


ze(n) = 4[2(n)+2°(-n)] and on) = 3 feln) - 2" (79)] (2.24) 


respectively. 
a. Modify the evenodd function discussed in the text so that it accepts an arbitrary 
sequence and decomposes it into its symmetric and antisymmetric components by 
implementing (2.24). 

b. Decompose the following sequence: 


a(n) = 10e704™, OS n< 10 


into its conjugate-symmetric and conjugate-antisymmetric components. Plot their real and 
imaginary parts to verify the decomposition. (Use the subplot function.) 
The operation of signal dilation (or decimation or down-sampling) is defined by 


y(n) = z(nM) 
in which the sequence z(n) is down-sampled by an integer factor M. For example, if 


z (n) (687843 765, -8..) 


then the down-sampled sequences by a factor 2 are given by 


y(n) = {...,-2,3,5,8,...} 
T 
a. Develop a MATLAB function dnsample that has the form 


function y = dnsample(x,M) 


to implement the above operation. Use the indexing mechanism of MATLAB with careful 
attention to the origin of the time axis n = 0. 

b. Generate z(n) = sin(0.125%n), —50 < n < 50. Decimate x(n) by a factor of 4 to 
generate y(n). Plot both z(n) and y(n) using subplot and comment on the ici 

c. Repeat the above using z(n) = sin(0.5brn), —50<n< 50. Qualitatively discuss the 
effect of down-sampling on signals. 

Determine the autocorrelation sequence ryz(£) and the crosscorrelation sequence rz, (£) for 


the following sequences. 
a(n) = (0.9)", O<n< 20; y(n) = (0.8)-", —-20<n<0 


What is your observation? 


to gS Mp cei i ee 
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In a certain concert hall, echoes of the original audio signal z(n) are generated due to the 
reflections at the walls and ceiling. The audio signal experienced by the listener y(n) is a 


combination of z(n) and its echoes. Let 
y(n) = x(n) + oz(n — k) 
where k is the amount of delay in samples and o is its relative strength. We want to 
estimate the delay using the correlation analysis. 
a. Determine analytically the autocorrelation ry,(é) in terms of the autocorrelation rz; (£). 


b. Let z(n) = cos(0.27n) + 0.5 cos(0.67), a = 0.1, and k = 50. Generate 200 samples of 
y(n) and determine its autocorrelation. Can you obtain a and k by observing ryy(£)? 
Three systems are given below. 


Ti [z(n)} = 27); Ty [x(n)] = 32(n) +4; Ta [x(n)] = a(n) + 2z(n — 1) — a(n — 2) 
a. Use (2.8) to determine analytically whether the above systems are linear. 


b. Let zi(n) be a uniformly distributed random sequence between [0,1] over 0 < n < 100, 
and let z?(n) be a Gaussian random sequence with mean 0 and variance 10 over 

0<n< 100. Using these sequences, test the linearity of the above systems. Choose any 
values for constants a; and az in (2.8). You should use several realizations of the above 
sequences to arrive at your answers. 

Three systems are given below. 


n n+10 
T, [2(n)] =} 2(k); — mis] = Y. st); 
0 n—10 
a. Use (2.9) to determine analytically whether the above systems are time-invariant. 
b. Let z(n) be a Gaussian random sequence with mean 0 and variance 10 over 0 < n < 100. 


Using this sequence, test the time invariance of the above systems. Choose any values for 


sample shift k in (2.9). You should use several realizations of the above sequence to arrive 
at your answers. 


Ts [z(n)] = z(—n) 


For the systems given in Problems 2.9 and 2.10 determine analytically their stability and 
causality. 


The linear convolution defined in (2.11) has several properties: 
zi(n) * x2(n) = zi(n) * za(n) 
[z1(n) * z2(n)] * zs(n) = zı (n) * [z2(n) * za(n)] : Association 
zi(n) * [z2(n) + zas(n)] = zi(n) * z2(n) + zi(n) * za(n) : Distribution 
z(n)*é(n—mno)- z(n—mo) . : Identity 
a. Analytically prove these properties. 


: Commutation 


(2.25) 


b. Using the following three sequences, verify the above properties. 
zi(n) 2 n [u(n + 10) — u(n — 20)] 
zo(n) = cos (0.1mn) [u(n) — u(n — 30)] 
za(n) = (1.2)" [u(n + 5) — u(n — 10)] 


Use the conv.m function. 
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P2.14 


P2.15 


P2.16 


When the sequences x(n) and h (n) are of finite duration Ns and Np, respectively, then 
their linear convolution (2.10) can also be implemented using matriz-vector multiplication. 
If elements of y(n) and z(n) are arranged in column vectors x and y respectively, then from 
(2.10) we obtain 


y = Hx 


where linear shifts in h (n — k) for n = 0,..., Na — 1 are arranged as rows in the matrix H. 
This matrix has an interesting structure and is called a Toeplitz matrix. To investigate this 
matrix, consider the sequences 


am = [i234] and a(n) = {3,2,1} 
T 1 


a. Determine the linear convolution y (n) = h (n) * z (n). 


b. Express z (n) as a 4 x 1 column vector x and y (n) as a 6 x 1 column vector y. Now 
determine the 6 x 4 matrix H so that y — Hx. 


c. Characterize the matrix H. From this characterization can you give a definition of a 
Toeplitz matrix? How does this definition compare with that of time invariance? 


d. What can you say about the first column and the first row of H? 


MATLAB provides a function called toeplitz to generate a Toeplitz matrix, given the first 
row and the first column. 


a. Using this function and your answer to Problem 2.13 part d, develop an alternate 
MATLAB function to implement linear convolution. The format of the function should be 


function [y,H]=conv_tp(h,x) 
% Linear Convolution using Toeplitz Matrix 


% Ly,H] = conv. tp(b, x) 

4 y = output sequence in column vector form 

4 H = Toeplitz matrix corresponding to sequence h so that y = Hx 
% h = Impulse response sequence in column vector form 

* x = input sequence in column vector form 


b. Verify your function on the sequences given in Problem 2.13. 
Let x(n) = (0.8)" u(n). 
a. Determine x(n) * x(n) analytically. 


b. Using the filter function, determine the first 50 samples of x(n) * x(n). Compare your 
results with those of part a. 


A particular linear and time-invariant system is described by the difference equation 
y(n) — 0.5y(n — 1) + 0.25y(n — 2) = a(n) + 2z(n — 1) + z(n — 3) 


a. Determine the stability of the system. 


b. Determine and plot the impulse response of the system over 0 < n < 100. Determine the 
stability from this impulse response. 
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c. If the input to this system is z(n) = [5 + 3cos(0.2zn) + 4sin(0.67n)] u(n), determine the 
response y(n) over 0 < n < 200. 


A "simple" digital differentiator is given by 
y(n) = z(n) - z(n — 1) 


which computes a backward first-order difference of the input sequence. Implement this 
differentiator on the following sequences and plot the results. Comment on the 
appropriateness of this simple differentiator. 


a. x(n) = 5[u(n) — u(n — 20)]: a rectangular pulse 
b. z(n) = n [u(n) — u(n — 10)] + (20 — n) [u(n — 10) - u(n — 20)]: a triangular pulse 
c. z(n) — sin (5) [u(n) — u(n — 100)]: a sinusoidal pulse 


o o e a MM. 
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THE DISCRETE-TIME 
FOURIER ANALYSIS 


We have seen how a linear and time-invariant system can be represented 
using its response to the unit sample sequence. This response, called the 
unit impulse response h(n), allows us to compute the system response to 
any arbitrary input x(n) using the linear convolution as shown below. 


z(n) —[h(n)|— y(n) = hln) + 2(n) 


This convolution representation is based on the fact that any signal can 
be represented by a linear combination of scaled and delayed unit sam- 
ples. Similarly, we can also represent any arbitrary discrete signal as a 
linear combination of basis signals introduced in Chapter 2. Each ba- 
sis signal set provides a new signal representation. Each representation 
has some advantages and some disadvantages depending upon the type 
of system under consideration. However, when the system is linear and 
time-invariant, only one representation stands out as the most useful. It 
is based on the complex exponential signal set {e7"} and is called the 
Discrete-time Fourier Transform. 


THE DISCRETE-TIME FOURIER TRANSFORM (DTFT) 
c 


If z(n) is absolutely summable, that is, Y lz(n)| < oo, then its 
discrete-time Fourier transform is given by 


oo 


X(e") È Fem = Y. sme” (31) 


n-—-—oo 


een 





[m] EXAMPLE 3.1 


Soluti 


o EXAMPLE 3.2 


TWO 
IMPORTANT 
PROPERTIES 


The inverse discrete-time Fourier transform (IDTFT) of X (e/") is given 
by 


n(n) 8. F- [X (e°) => J X(e&")e"^do 8 


—- 


The operator F [-] transforms a discrete signal x(n) into a complex-valued 
continuous function X (e/") of real variable w, called a digital frequency, 
which is measured in radians. 


Determine the discrete-time Fourier transform of x(n) = (0.5)" u(n). 


The sequence r(n) is absolutely summable; therefore its discrete-time Fourier 
transform exists. 
X(e) = Y zine" = $ (0.5)^ e?" 
—oo0 0 
x 
0 


-juyn 1 sires 
(05e ) ~ 1-—05e-j ev —05 F 


Determine the discrete-time Fourier transform of the following finite-duration 
sequence: 


z(n) = {1,2,3,4,5} 
t 


Using definition (3.1), 


oo 
Xx(e")- So afne” =e 424 3e 34 4 4e 329 + 5e 779 


=% 


Since X(e") is a complex-valued function, we will have to plot its mag- 
nitude and its angle (or the real and the imaginary part) with respect to w 
separately to visually describe X (e^). Now w is a real variable between —oo 
and oo, which would mean that we can plot only a part of the X (e^) func- 
tion using MATLAB. Using two important properties of the discrete-time Fourier 
transform, we can reduce this domain to the [0, 7] interval for real-valued se- 
quences. We will discuss other useful properties of X (e?) in the next section. 

D 


We will state the following two properties without proof. 
1. Periodicity: The discrete-time Fourier transform X (e™) is periodic 
in w with period 27. 


X(e") = X (gil? 


ne 
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Implication: We need only one period of X (e^) (i.e., w €[0, 27], or [—7, x], 
etc.) for analysis and not the whole domain —oo < w « oo. 
2. Symmetry: For real-valued x(n), X(e/) is conjugate symmetric. 


X(e^7") = X* (e) 
or 
Re[X (e~)] = Re[X(e%*)] 
Im[X (e~”)] = — Im[X(e*”)] (odd symmetry) 
|x(e™)| = |X(e%)| 
LX(e*) = -LX(e”) 


(even symmetry) 


(even symmetry) 
(odd symmetry) 


Implication: To plot X (eJ), we now need to consider only a half period 
of X (ei). Generally, in practice this period is chosen to be w € 0, 7]. 


If x(n) is of infinite duration, then MATLAB cannot be used directly to 
compute X(e%”) from z(n). However, we can use it to evaluate the ex- 
pression X (e^) over [0,7] frequencies and then plot its magnitude and 
angle (or real and imaginary parts). 


Evaluate X(e/") in Example 3.1 at 501 equispaced points between [0,7] and 
plot its magnitude, angle, real, and imaginary parts. 


MATLAB Script 





>> w = [0:1:500]*p3/500; % [0, pi] axis divided into 501 points. 

>> X = exp(j*w) ./ (exp(j*w) - 0.5*ones(1,501)); 

>> magX = abs(X); angX = angle(X); 

>> realX = real(X); imagX = imag(X); 

>> subplot(2,2,1); plot(w/pi,magX); grid 

>> xlabel('frequency in pi units’); title('Magnitude Part’); ylabel(’Magnitude’) 
>> subplot (2,2,3); plot(w/pi,angX); grid 

>> xlabel('frequency in pi units’); title(’Angle Part’); ylabel(’Radians’) 

>> subplot(2,2,2); plot(w/pi,realX); grid 

>> xlabel(’frequency in pi units’); title(’Real Part’); ylabel(’Real’) 

>> subplot (2,2,4); plot(w/pi,imagX); grid 

>> xlabel(’frequency in pi units’); title(’Imaginary Part’); ylabel(’ Imaginary’) 





42 


The resulting plots are shown in Figure 3.1. Note that we divided the w array by 
pi before plotting so that the frequency axes are in the units of 7 and therefore 
easier to read. This practice is strongly recommended. n 
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FIGURE 3.1 Plots in Example 3.3 


If z(n) is of finite duration, then MATLAB can be used to compute 
X(e/^) numerically at any frequency w. The approach is to implement 
(3.1) directly. If, in addition, we evaluate X (e/") at equispaced frequen- 
cies between [0, 7], then (3.1) can be implemented as a matrix-vector mul- 
tiplication operation. To understand this, let us assume that the sequence 
z(n) has N samples between n; < n € ny (i.e., not necessarily between 
[0, N — 1]) and that we want to evaluate X (e^) at 


AT 
we = 


which are (M + 1) equispaced frequencies between [0, 1]. Then (3.1) can 
be written as 


k, k=0,1,...,M 


N . 
X(ei**) = e fM (ng), k=0,1,...,M 
ta 


When {z (n;)) and (X(e/**)) are arranged as column vectors x and X, 
respectively, we have 


X = Wx (3.3) 
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Solution 


where W is an (M + 1) x N matrix given by 
wê [e rris m Zn£nw, k=0,1,.. 4M] 


In addition, if we arrange {k} and (n,) as row vectors k and n respectively, 
then 


we [ow Cra 


In MATLAB we represent sequences and indices as row vectors; therefore 
taking the transpose of (3.3), we obtain 


X? =x? [exp (- j ;"t)] (3.4) 


Note that nk is an N x (M + 1) matrix. Now (3.4) can be implemented 
in MATLAB as follows. 


>> k = [0:M]; n = (n1:n2]; 
>> X= x * (exp(-j*pi/M) .^ (n'*k); 


Numerically compute the discrete-time Fourier transform of the sequence z(n) 
given in Example 3.2 at 501 equispaced frequencies between [0, 7]. 


MATLAB Script 
>> n = -1:3; x = 1:5; 

>> k = 0:500; w = (pi/500)*k; 

>> X = x * (exp(-j*pi/500) .^ (n’*k); 

>> magX = abs(X); angX = angle(X); 

>> realX = real(X); imagX = imag(X); 

>> subplot (2,2,1); plot(k/500,magX) ; grid 

>> xlabel(’frequency in pi units’); title(’Magnitude Part’) 
>> subplot (2,2,3); plot (k/500,angX/pi) ; grid 

>> xlabel(’frequency in pi units’); title(’Angle Part’) 

>> subplot(2,2,2); plot(k/500,realX) ; grid 

>> xlabel(’frequency in pi units’); title(’Real Part’) 

>> subplot (2,2,4); plot (k/500, imagX) ; grid 

>> xlabel('frequency in pi units’); title(’Imaginary Part’) 








The frequency-domain plots are shown in Figure 3.2. Note that the angle plot 
is depicted as a discontinuous function between —7 and 7. This is because the 
angle function in MATLAB computes the principal angle. a 


The procedure of the above example can be compiled into a MATLAB 
function, say a dtft function, for ease of implementation. This is explored 
in Problem 3.1. This numerical computation is based on definition (3.1). 
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FIGURE 3.2 Plots in Example 3.4 


It is not the most elegant way of numerically computing the discrete-time 
Fourier transform of a finite-duration sequence. Furthermore, it creates an 
N x (M + 1) matrix in (3.4) that may exceed the size limit in the Student 
Edition of MATLAB for large M and N. In Chapter 5 we will discuss in 
detail the topic of a computable transform called the discrete Fourier 
transform (DFT) and its efficient computation called the fast Fourier 
transform (FFT). Also there is an alternate approach based on the z- 
transform using the MATLAB function freqz for finite-duration sequences, 
which we will discuss in Chapter 4. In this chapter we will continue to use 
the approaches discussed so far for calculation as well as for investigation 
purposes. 

In the next two examples we investigate the periodicity and symmetry 
properties using complex-valued and real-valued sequences. 


Let z(n) = (0.9exp(j«/3))^, 0 € n € 10. Determine X (e^) and investigate 
its periodicity. 


Since z(n) is complex-valued, it satisfies only the periodicity property. Therefore 
it is uniquely defined over one period of 27. However, we will evaluate and plot it 
at 401 frequencies over two periods between (—2z, 27] to observe its periodicity. 


Mi INE ——————É———————Á—— 
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[m] EXAMPLE 3.6 


Solution 





>> n = 0:10; x = (0.9*exp(j*pi/3)).^n; 

>> k = -200:200; w = (pi/100)*k; 

>> X = x * (exp(-j*pi/100) .^ (n’*k); 

>> magX = abs(X); angX =angle(X); 

>> subplot(2,1,1); plot(w/pi,magX);grid 

>> xlabel('frequency in units of pi’); ylabelC |X|?) 

>> title(’Magnitude Part’) 

>> subplot (2,1,2); plot(w/pi,angX/pi) ; grid 

>> xlabel('frequency in units of pi’); ylabel(’radians/pi’) 
>> title(’Angle Part’) 


From the plots in Figure 3.3 we observe that X (e”) is periodic in w but is not 
conjugate-symmetric. ü 


Let z(n) 22^, -10 € n < 10. Investigate the conjugate-symmetry property 
of its discrete-time Fourier transform. 


Once again we will compute and plot X (e^) over two periods to study its 
symmetry property. 
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FIGURE 3.3 Plots in Example 3.5 
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FIGURE 3.4 Plots in Example 3.6 


subplot (1,1, 1) 

n = -5:5; x = (-0.9).°n; 

k = -200:200; w = (pi/100)*k; 

X = x * (exp(-jspi/100) .^ (n'*k); 

magX = abs(X); angX =angle(X); 

subplot (2,1,1); plot (w/pi ,nagX);grid 
axis([-2,2,0,15]) 

xlabel(’frequency in units of pi’); ylabel(’ XI’) 
title(’Magnitude Part’) 

subplot (2,1,2); plot (w/pi,angX)/pi;grid 
axis({-2,2,-1,1]) 

xlabel(’ frequency in units of pi’); ylabel('radians/pi') 
title('Angle Part’) 


From the plots in Figure 3.4 we observe that X(e/^) is not only periodic in w 
but is also conjugate-symmetric. Therefore for real sequences we will plot their 
Fourier transform magnitude and angle responses from 0 to 7. o 


THE PROPERTIES OF THE DTFT 
ee 


In the previous section we discussed two important properties that we 
needed for plotting purposes. We now discuss the remaining useful proper- 


oa a Ae ee ee 
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ties, which are given below without proof. Let X (e?) be the discrete-time 
Fourier transform of z(n). 


1. Linearity: The discrete-time Fourier transform is a linear transfor- 
mation; that is, 


F jazi (n) + Br2(n)| = oF [x1 (n)] + BF [zz (n)] (3.5) 
for every a, 3, z1 (n), and 22 (n). 
2. Time shifting: A shift in the time domain corresponds to the phase 
shifting. 
F [x(n — k)] = X (e”)e5vk (3.6) 
3. Frequency shifting: Multiplication by a complex exponential cor- 
responds to a shift in the frequency domain. 
F [a(n)eir] = X (679) (3.7) 


4. Conjugation: Conjugation in the time domain corresponds to the 
folding and conjugation in the frequency domain. 


F [z*(n)] = X*(e?") (3.8) 


5. Folding: Folding in the time domain corresponds to the folding in 
the frequency domain. 


F ([z(-9)] = X (e) (3.9) 


6. Symmetries in real sequences: We have already studied the conju- 
gate symmetry of real sequences. These real sequences can be decomposed 
into their even and odd parts as we discussed in Chapter 2. 


z(n) = xe(n) + zo(n) 
Then 
F [ze(n)] = Re [X(e™)] 


3.10 
F [zo(n)] = j Im [X(e*)] v 


Implication: If the sequence z(n) is real and even, then X (e^) is also 
real and even. Hence only one plot over [0, 7] is necessary for its complete 
representation. 

A similar property for complex-valued sequences is explored in Prob- 
lem 3.7. 

7. Convolution: This is one of the most useful properties that makes 
system analysis convenient in the frequency domain. 


F [rs (n) * 2(n)] = F [21 (n)] F [ea(n)} = Xa(e™) Xa) B) 


a ee PUR RA Pr Wer TOP 
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8. Multiplication: This is a dual of the convolution property. 


Flzs(0) -20(n)] li] © Fla] Ê E [ Xaxado 
: (3.12) 


The convolution-like operation above is called a periodic convolution and 
hence denoted by . It is discussed (in its discrete form) in Chapter 5. 
9. Energy: The energy of the sequence z(n) can be written as 


oo T 


Es = Liem = = I |X (e)? dw (3.13) 


-=r 


T ES 
|x(e*)| 
= m ndo (for real sequences using even symmetry) 
0 


This is also known as Parseval’s Theorem. From (3.13) the energy density 
spectrum of x(n) is defined as 


(w) È EGH (3.14) 


7T 


Then the energy of x(n) in the [w1,wo] band is given by 
wa 
f 9». OSW <w ST 
wi 


In the next several examples we will verify some of these properties 
using finite-duration sequences. We will follow our numerical procedure 
to compute discrete-time Fourier transforms in each case. Although this 
does not analytically prove the validity of each property, it provides us 
with an experimental tool in practice. 


In this example we will verify the linearity property (3.5) using real-valued finite- 
duration sequences. Let z;(n) and za(n) be two random sequences uniformly 
distributed between [0,1] over 0 € n < 10. Then we can use our numerical 
discrete-time Fourier transform procedure as follows. 


xi = rand(1,11); x2 = rand(1,11); n = 0:10; 

alpha = 2; beta = 3; 

k = 0:500; w = (pi/500)*k; 

Xi = xi * (exp(-j*pi/500)).^(n'*k); % DTFT of x1 

X2 = x2 + (exp(-j*pi/500)).^(n'*»k); X DTFT of x2 

x = alpha*xi + beta*x2; X Linear combination of xi & x2 
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>> X = x * (exp(-j*pi/500)).^(n'*k); X DTFT of x >> xlabel(’frequency in pi units’); ylabel(C |Y|?) 

>> % verification >> title(’Magnitude of Y?) 

>> X check = alphat*Xi + beta*X2; ¥, Linear Combination of X1 & X2 >> subplot(2,2,4); plot(w/pi,angle(Y)/pi); grid; axis(([-1,1,-1,1]) 

>> error = max(abs(X-X check)) * Difference >> xlabel(’frequency in pi units’); ylabel(’radians/pi’) 

error = >> title(’Angle of Y?) 

7.1054e-015 

Since the maximum absolute error between the two Fourier transform arrays "d Kom P lots a Figure 3.5 we observe that X (e/") is indeed shifted by 7/4 
is less than 10715, the two arrays are identical within the limited numerical ~ in both magnitude and angle. o 
precision of MATLAB. o 


O EXAMPLE3.10 To verify the conjugation property (3.8), let z(n) be a complex-valued random 
sequence over —5 € n < 10 with real and imaginary parts uniformly distributed 


Ci  EXAMPLE38 Let x(n) be a random sequence uniformly distributed between [0,1] over 0 < 
between [0, 1]. The MATLAB verification is as follows. 


n € 10 and let y(n) = z(n — 2). Then we can verify the sample shift property 
(3.6) as follows. 
>> n = -5:10; x = rand(i,length(n)) + j*rand(1,length(n)); 


>> x = rand(1,11); n = 0:10; >> k = -100:100; w = (pi/100)*k; y ET . 
>> k = 0:500; w = (pi/500)*k; »X-x* (xs dot oo QUAE s M between pi ane tpa 
; >> X = x * (exp(-j*pi/500)) .^(n?*k); % DTFT of x % conjugation property 

| >> % signal shifted by two samples >> y = conj(x); % signal conjugation 

i aae won >> Y = y * (exp(-j*pi/100)).7(n'«k); — X DTFT of y 

| >> Y = y * (exp(-j*pi/500)) .^ (n? *k) ; % DTFT of y % verification 

| >> % verification >> Y_check = conj(fliplr(X)); % conj (X(-w)) 

I >> Y.check = (exp(-j*20.^w) .*X; % multiplication by exp(-j2w) 

1 >> error = max(abs(Y-Y check)) X Difference 

i error = 

M 5.7737e-015 a Magnitude of X Angle of X 


i D EXAMPLE 3.9 To verify the frequency shift property (3.7), we will use the graphical approach. 
Let 


l z(n) = cos(mn/2) OSn<100 and y(n) = &""/" z(n) 


radiands/pi 





i Then using MATLAB, 





1 

| >> n = 0:100; x = cos(pi*n/2); 9 05 s 05 A -1 

| >> k = -100:100; w = (pi/100)*k; % frequency between -pi and +pi frequency in pi units i Aetuenóy i b ints 1 
>> X = x * (exp(-j*pi/100) .^(n'*k); % DTFT of x Magnitude of Y 
4 60 Angle of Y 


>> y = exp(j*pi*n/4).*x; * signal multiplied by exp(j*pi*n/4) 

: >> Y = y * (exp(-j*pi/100)).^(n'*k); X4 DTFT of y 

l % Graphical verification 

»» subplot(1,1,1) x 
>> subplot(2,2,1); plot(w/pi,abs(X)); grid; axis({-1,1,0,60]) 20 
>> xlabel(’frequency in pi units’); ylabel(’|XI’) 
>> title(’Magnitude of X") 


radians/pi 








>> subplot (2,2,2); plot (w/pi,angle(X)/pi); grid; axis([-1,1,-1,1]) oF ve = , 

>> xlabel(’frequency in pi units’); ylabel(’radiands/pi’) 05 0 05 1 4 205 0 05 1 

>> title(C Angle of Y?) Nue v Up un frequency in pi units 

»» subplot(2,2,3); plot(w/pi,abs(Y)); grid; axis([-1,1,0,60]) FIGURE 3.5 Plots in Example 3.9 
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>> error = max(abs(Y-Y check)) 4, Difference z Real part of X Imaginary part of X 
error = : f B 
0 (m) à 5 
DH —EXAMPLE311 To verify the folding property (3.9), let x(n) be a random sequence over -5< ! & 0 = 0 
n X 10 uniformly distributed between [0,1]. The MATLAB verification is as [4 £ 
follows. AL -5 
>> n -5:10; x = rand(1,length(n)); -2 : -10 
>> k = -100:100; w = (pi/100)*k; % frequency between -pi and +pi -71  -05 0 O05 1 -1 -0.5 o 05 1 
>> X = x * (exp(-j*pi/100)).^(n^*k); % DTFT of x frequency in pi units frequency in pi units 
% folding property ^ Transform of even part Transform of odd part 
>> y = fliplr(x); m = -fliplr(n); % signal folding 
>> Y = y * (exp(-j*pi/100)) .^(n?*k) ; X DTFT of y 1 
% verification 
>> Y.check = fliplr(X); % X(-w) Wo 
>> error = max(abs(Y-Y check)) 4 Difference aa 
error = m 
0 a 
-2 -10 : H 1 
O EXAMPLE 312 In this problem we verify the symmetry property (3.10) of real signals. Let -1  -05 0 0.5 1 - -05 0 0.5 1 


frequency in pi units frequency in pi units 
z(n)-sin(mn/2, -5<n<10 FIGURE 3.6 Plots in Example 3.12 


Then using the evenodd function developed in Chapter 2, we can compute 
the even and odd parts of z(n) and then evaluate their discrete-time Fourier 
transforms. We will provide the numerical as well as graphical verification. 


v 


>> subplot(2,2,2); plot(w/pi,XI); grid; axis([-1,1,-10,10]) 
>> xlabel(’frequency in pi units’); ylabel(’Im(X)’); 


>> n = -5:10; x = sin(pi*n/2); >> title(’ Imaginary part of X?) 


>> k = -100:100; w = (pi/100)*k; % frequency between -pi and +pi >> subplot (2,2,3); plot(w/pi,real(XE)); grid; axis([-1,1,-2,2]) 
>> X = x * (exp(-j*pi/100)) .^(n?*X) ; X DTFT of x >> xlabel(’frequency in pi units’); ylabel XE’); diis 

% signal decomposition >> title(’Transform of even part’) : 

>> [xe,xo,m) = evenodd(x,n); % even and odd parts >> subplot (2,2,4); plot(w/pi,imag(X0)); grid; axis([-1,1,-10,10]) 


>> XE = xe * (exp(-j*pi/100)).^(m'*k); % DTFT of xe 
>> KO = xo * (exp(-j*pi/100)).^(m'*k); % DTFT of xo 
% verification 


>> xlabel(’frequency in pi units’); ylabel(’X0’); 
>> title(’Transform of odd part’) 


>> XR = real(X); % real part of X 

>> errori = max(abs(XE-XR)) % Difference From the plots in Figure 3.6 we observe that the real part of X (e) (or the 

errori - imaginary part of X(e/^)) is equal to the discrete-time Fourier transform of 
1.8974e-019 ae(n) (or zo(n)). a 

>> XI = imag(X); % imag part of X 

>> error2 = max(abs(X0-j*X1)) % Difference 

rrorz = 
e EORUM THE FREQUENCY DOMAIN REPRESENTATION OF LT! SYSTEMS 
—— — — 


* graphical verification 
»» subplot(1,1,1) 


>> subplot(2,2,1); plot(w/pi,XR); grid; axis([-1,1,-2,2]) We earlier stated that the Fourier transform representation is the most 
>> xlabel('frequency in pi units?); ylabel(’Re(X)’); useful signal representation for LTI systems. It is due to the following 
>> title(’Real part of X?) result. 
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RESPONSE TO Let 2(n) = e^?" be the input to an LTI system represented by the impulse 
A COMPLEX response h(n). 
EXPONENTIAL 


ejon ejwon _, — h(n) + ej«on 


Then 


y(n) = h(n) » e" = Y Agen 


-—00 


= 5 dl eivon (3.15) 


oo 


= [F Aou] e" 


m DEFINITION! Frequency Response 
The discrete-time Fourier transform of an impulse response is called 
the Frequency Response (or Transfer Function ) of an LTI system and is 
denoted by 


H (e) È S h(n)e "^ (3.16) 


-—00 


Then from (3.15) we can represent the system by 


a(n) = e” —, — y(n) = H(e^») x eo" (3.17) 


Hence the output sequence is the input exponential sequence modified by 
the response of the system at frequency wo. This justifies the definition 
of H(e#”) as a frequency response because it is what the complex expo- 
nential is multiplied by to obtain the output y(n). This powerful result 
can be extended to a linear combination of complex exponentials using 
the linearity of LTT systems. 


Y Aen — — Y AH (ej**) ee” 
k k 


Tn general, the frequency response H (e) is a complex function of w. The 
magnitude |H(e/*)| of H(e%) is called the magnitude (or gain) response 
function, and the angle /H(e%) is called the phase response function as 
we shall see below. 


RESPONSE TO ^ Let x(n) = Acos(won + 6o) be an input to an LTI system h(n). Then 
SINUSOIDAL from (3.17) we can show that the response y(n) is another sinusoid of the 
SEQUENCES same frequency wp, with amplitude gained by | H(e/*^)| and phase shifted 


Ne 
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by ZH(e*), that is, 
y(n) =A |H(e%°)| cos (won + ĝo + LH(e°)) (3.18) 


This response is called the steady-state response denoted by y,,(n). It can 
be extended to a linear combination of sinusoidal sequences. 


YA cos(uyn + 8.) — US YA |H(e%**)| cos (wen + 0, + LH(e*)) 
k k 


RESPONSE TO Finally, (3.17) can be generalized to arbitrary absolutely summable se- 
ARBITRARY quences. Let X(e") = F[x(n)] and Y (e/") = F[y(n)]; then using the 
SEQUENCES convolution property (3.11), we have 


Y (ei) = H(t) X(e") (3.19) 


Therefore an LTI system can be represented in the frequency domain by 


X(e) — — ¥(e) = H(e) X(e”) 


The output y(n) is then computed from Y (e^) using the inverse discrete- 
time Fourier transform (3.2). This requires an integral operation, which is 
not a convenient operation in MATLAB. As we shall see in Chapter 4, there 
is an alternate approach to the computation of output to arbitrary inputs 
using the z-transform and partial fraction expansion. In this chapter we 
will concentrate on computing the steady-state response. 


O EXAMPLE313 Determine the frequency response H(e/") of a system characterized by h(n) = 
(0.9)"u(n). Plot the magnitude and the phase responses. 


Solution Using (3.16), 
oo " oo 
H(i) = Y h(n)e ?"^ = $00.9)" ^ 

-—o0 0 

"A" WNT a 

= 5 (09e? = 1— eio 
o 

Hence 


idx ee 1 = 1 
|ge ) ~ V (1—-039cosu)? + (0.9sinw)? ~ J/T81 — 1.8cosw 


0.9sinw | 
1 — 0.9 cosw 


and 


£ H (e^) = — arctan [ 


a a re TTS 
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O EXAMPLE 3.14 


Solution 
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To plot these responses, we can either implement the |H (e*)| and ZH(e") 
functions or the frequency response H (e) and then compute its magnitude 
and phase. The latter approach is more useful from a practical viewpoint (as 
shown in (3.18)). 


>> w = [0:1:500]*pi/500; % [0, pi] axis divided into 501 points. 
>> H = exp(jew) ./ Cexp(j*w) - 0.9*ones(1,501)) ; 

>> magH = abs(H); angH = angle(H); 

»» subplot(2,1,1); plot(w/pi,magH); grid; 

>> xlabel(’frequency in pi units’); ylabelOC lHl 5 

>> title(’Magnitude Response’); 

>> subplot(2,1,2); plot(w/pi,angH/pi); grid 

>> xlabel(’frequency in pi units’); ylabel('Phase in pi Radians’); 
>> title(’Phase Response’); 


The plots are shown in Figure 3.7. o 


Let an input to the system in Example 3.13 be 0.1u(n). Determine the steady- 
state response yss(n). 


Since the input is not absolutely summable, the discrete-time Fourier transform 
is not particularly useful in computing the complete response. However, it can 
be used to compute the steady-state response. In the steady state (i.e., n — co) 


Magnitude Response 
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FIGURE 3.7 Frequency response plots in Example 3.13 
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O EXAMPLE 3.15 
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the input is a constant sequence (or a sinusoid with wo = fo = 0). Then the 
output is 


yss(n) = 0.1 x H(e?) =0.1x 10=1 


where the gain of the system at w = 0 (also called the DC gain) is H(e?°) = 10, 
which is obtained from Figure 3.7. o 


When an LTI system is represented by the difference equation 


N M 
y(n) + X aey(n -£-2 Y b, z(n — m) (3.20) 


ł=1 m=0 


then to evaluate its frequency response from (3.16), we would need the im- 
pulse response h(n). However, using (3.17), we can easily obtain H (e^). 
We know that when z(n) = e^, then y(n) must be H(e/")e"". Substi- 
tuting in (3.20), we have 


N M 
H (e^ )e*" + Y uA ie- = Yb enc m 


f=1 m=0 


or 


M 


H(i”) = = (3.21) 


N 
1+ D ag e»t 
£—1 





after canceling the common factor e^" term and rearranging. This equa- 
tion can easily be implemented in MATLAB, given the difference equation 
parameters. 


An LTI system is specified by the difference equation 
y(n) = 0.8y(n — 1) + x(n) 


a. Determine H (e^). 
b. Calculate and plot the steady-state response y,s(n) to 


z(n) = cos(0.057n)u(n) 


Rewrite the difference equation as y(n) — 0.8y(n — 1) = x(n). 
a. Using (3.21), we obtain 


1 


Hle”) = 79 eco 


(3.22) 











b. In the steady state the input is z(n) — cos(0.057n) with frequency 
wo = 0.057 and 8o = 0°. The response of the system is 


j0.05m _ 1 
H(g^***) = 7 


oR = 4.092867 79.5377 
— U.be7" 


Therefore 
ysa(n) = 4.0928 cos(0.05mn — 0.5377) = 4.0928 cos [0.057 (n — 3.42)] 


This means that at the output the sinusoid is scaled by 4.0928 and shifted by 
3.42 samples. This can be verified using MATLAB. 


»» subplot(1,1,1) 

>> b= 1; a= [1,-0.8]; 

>> n=[0:100) ;x = cos(0.05*pi*n); 

> y= filter(b,a,x); 

>> subplot(2,1,1); sten(n,x); 

>> xlabel(’n’); ylabel(’x(n)’); title(^ Input sequence’) 
>> subplot(2,1,2); stem(n,y); 

>> xlabel(’n’); ylabel(’y(n)’); title( Output sequence?) 


From the plots in Figure 3.8 we note that the amplitude of y,,(n) is approxi- 
mately 4. To determine the shift in the output sinusoid, we can compare zero 





FIGURE 3.8 Plots in Example 3.15 
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D EXAMPLE 3.16 


crossings of the input and the output. This is shown in Figure 3.8, from which 
the shift is approximately 3.5 samples. D 


In Example 3.15 the system was characterized by a first-order differ- 
ence equation. It is fairly straightforward to implement (3.22) in MATLAB 
as we did in Example 3.13. In practice the difference equations are of large 
order and hence we need a compact procedure to implement the general 
expression (3.21). This can be done using a simple matrix-vector multi- 
plication. If we evaluate H (e) at k —0,1,...,K equispaced frequencies 
over [0,7], then 


M 
y ' bm eg ivm 


H(gi^*) = = ] 
1+ Y a, ejt 
£1 


If we let {bm}, {ae} (with ao = 1), (m — 0,..., M), {€=0,...,N}, and 
(ux) be arrays (or row vectors), then the numerator and the denominator 
of (3.23) become 


k=0,1,...,K (3.23) 


bexp(—jm™w); aexp (-i£u) 


respectively. Now the array H (e/**) in (3.23) can be computed using a ./ 
operation. This procedure can be implemented in a MATLAB function to 
determine the frequency response function, given {bm} and {ag} arrays. 
We will explore this in Example 3.16 and in Problem 3.15. 


A 3rd-order lowpass filter is described by the difference equation 
y(n) = 0.0181z(n) + 0.0543z(n — 1) + 0.0543z(n — 2) + 0.0181z(n — 3) 
+ 1.76y(n — 1) — 1.1829y(n — 2) + 0.2781y(n — 3) 


Plot the magnitude and the phase response of this filter and verify that it is a 
lowpass filter. 


Solution We will implement the above procedure in MATLAB and then plot the filter 
responses. 
>> b = [0.0181, 0.0543, 0.0543, 0.0181]; % filter coefficient array b 
>> a = (1.0000, -1.7600, 1.1829, -0.2781]; 4 filter coefficient array a 
>> m = O:length(b)-1; 1 = O:length(a)-1; % index arrays m and 1 
>> K = 500; k = 0:1:K; % index array k for frequencies 
>> w = pitk/K; % (0, pi] axis divided into 501 points. 
>> num = b + exp(-j*n'*v); % Numerator calculations 
chea a ee SS eo 
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>> den = a * exp(-j*1'*w); 
>> H = num ./ den; 
>> magH = abs(H); angH = angle(H); 
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FIGURE 3.9 Plots for Example 3.16 


% Denominator calculations 
% Frequency response 
% mag and phase responses 


>> subplot(1,1,1); 

>> subplot (2,1,1); plot(w/pi,magH); grid; axis([0,1,0,1]) 

>> xlabel('frequency in pi units’); ylabel(’ HI’); 

>> title('Magnitude Response’) ; 

>> subplot(2,1,2); plot(w/pi,angH/pi); grid 

>> xlabel(’frequency in pi units’); ylabel(’Phase in pi Radians’); 
>> title(’Phase Response’); 


From the plots in Figure 3.9 we see that the filter is indeed a lowpass filter. O 


SAMPLING AND RECONSTRUCTION OF ANALOG SIGNALS 
—$—$ 


In many applications—for example, in digital communications—real- 
world analog signals are converted into discrete signals using sampling 
and quantization operations (collectively called analog-to-digital con- 
version or ADC). These discrete signals are processed by digital signal 
processors, and the processed signals are converted into analog signals 
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SAMPLING 


using a reconstruction operation (called digital-to-analog conversion or 
DAC). Using Fourier analysis, we can describe the sampling operation 
from the frequency-domain viewpoint, analyze its effects, and then ad- 
dress the reconstruction operation. We will also assume that the number 
of quantization levels is sufficiently large that the effect of quantization 
on discrete signals is negligible. 


Let z,(t) be an analog (absolutely integrable) signal. Its continuous-time 
Fourier transform (CTFT) is given by 


x,ü0) Ê f zo (t)e -i tdt (3.24) 


=00 


where Q is an analog frequency in radians/sec. The inverse continuous- 
time Fourier transform is given by 


zali) = = f x,(jQ)e'?'an (3.25) 


We now sample xq(t) at sampling interval T, seconds apart to obtain the 
discrete-time signal x(n). 
z(n) E za( nT,) 


Let X (e/") be the discrete-time Fourier transform of z(n). Then it can be 
shown [19] that X (e^) is a countable sum of amplitude-scaled, frequency- 
scaled, and translated versions of the Fourier transform X4(Q). 


X(e) = H Xx l (s = z^ (3.26) 


The above relation is known as the aliasing formula. The analog and 
digital frequencies are related through Ts 

w= OT; (3.27) 
while the sampling frequency F, is given by 


1 
F, ==, sam/sec (3.28) 

T, 
The graphical illustration of (3.26) is shown in Figure 3.10, from which 
we observe that, in general, the discrete signal is an aliased version of the 
corresponding analog signal because higher frequencies are aliased into 


NN 
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FIGURE 3.10 Sampling operation in the time and frequency domains 


lower frequencies if there is an overlap. However, it is possible to recover 
the Fourier transform X4,(jf?) from X (e^) (or equivalently, the analog 
signal z,(t) from its samples z(n)) if the infinite "replicas" of X,(jf?) do 
not overlap with each other to form X (e). This is true for band-limited 
analog signals. 


Band-limited Signal 
A signal is band-limited if there exists a finite radian frequency Qo 


such that Xq(jQ) is zero for |(| > No. The frequency Fo-Q9/27 is called 
the signal bandwidth in Hz. 
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Referring to Figure 3.10, if n > QoT,—or equivalently, F,/2 > Fo— 
then 


; 1 w T w T 
X(é")2—Xlimbh -m< asa 
NER ( r) nh n4 


which leads to the sampling theorem for band limited signals. 


(3.29) 


Sampling Principle 

A band-limited signal £a(t) with bandwidth Fo can be reconstructed 
from its sample values x(n) = zo (nT,) if the sampling frequency F, = 
1/T, is greater than twice the bandwidth Fo of x(t). 


F, > 2Fo 


Otherwise aliasing would result in x(n). The sampling rate of 2Fo for an 
analog band-limited signal is called the Nyquist rate. 


It should be noted that after z,(f) is sampled, the highest analog 
frequency that z(n) represents is F,/2 Hz (or w = 1). This agrees with 
the implication stated in Property 2 of the discrete-time Fourier transform 
in the first section of this chapter. 


In a strict sense it is not possible to analyze analog signals using MATLAB 
unless we use the Symbolic toolbox. However, if we sample z, (f) on a fine 
grid that has a sufficiently small time increment to yield a smooth plot 
and a large enough maximum time to show all the modes, then we can 
approximate its analysis. Let At be the grid interval such that At < Ts. 
Then 
^ 

zg(m) = za (mAt) (3.30) 
can be used as an array to simulate an analog signal. The sampling interval 
T, should not be confused with the grid interval At, which is used strictly 
to represent an analog signal in MATLAB. Similarly, the Fourier transform 
relation (3.24) should also be approximated in light of (3.30) as follows 


X,GQ) & V 1 zo(m)e 7? "^ At = At Yose(m) "^ — (331) 


Now if za(t) (and hence za (m)) is of finite duration, then (3.31) is similar 
to the discrete-time Fourier transform relation (3.3) and hence can be 
implemented in MATLAB in a similar fashion to analyze the sampling 
phenomenon. 
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D EXAMPLE 3.17 


Solution 
oO EXAMPLE 3.18 
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Let a(t) = e^ 199?! Determine and plot its Fourier transform. 


From (3.24) 
eo 0 eo 
X.g9) = faoa- [eaer [ mea 
Se Te o 
0.002 


1+ GÀ) 


which is a real-valued function since Ta(t) is a real and even signal. To evaluate 
Xa(jQ) numerically, we have to first approximate x(t) by a finite-duration 
grid sequence za(m). Using the approximation e^? ~ 0, we note that £a(t) 
can be approximated by a finite-duration signal over —0.005 < £ < 0.005 (or 
equivalently, over (—5,5] msec). Similarly from (3.32), Xa(jQ) & 0 for Q > 


2n (2000). Hence choosing 


At-25x10?« —25x1075 


1 
2 (2000) 


we can obtain zc(m) and then implement (3.31) in MATLAB. 


% Analog Signal 

>> Dt = 0.00005; t = -0.005:Dt:0.005; xa = exp(-1000*abs(t)); 
% Continuous-time Fourier Transform 

>>Wmax = 2*pi*2000; K = 500; k = 0:1:K; W = k*Wnax/K; 

»»Xa = xa * exp(-j*t'*W) * Dt; Xa = real(Xa); 

»»W = [-fliplr(W), W(2:501)]; % Omega from -Wmax to Wmax 
»»Xa = [fliplr(Xa), Xa(2:501)]; % Xa over -Wmax to Wmax interval 
>>subplot (1,1,1) 

»»subplot(2,1,1);plot(t*1000,xa); 

»»xlabel(?t in msec.’); ylabel(’xa(t)’) 

»»title(C Analog Signal’) 

»»subplot(2,1,2);plot(W/(2*pi*1000) ,Xa*1000) ; 
>>xlabel(’Frequency in KHz’); ylabel(?Xa(jW)*1000!) 
>>title(’Continuous-time Fourier Transform’) 


Figure 3.11 shows the plots of ra(t) and Xa(j). Note that to reduce the number 
of computations, we computed X,(jf?) over [0, 40007] radians/sec (or equiva- 
lently, over [0,2] KHz) and then duplicated it over [—40007, 0] for plottin; 


purposes. The displayed plot of X,(jf?) agrees with (3.32). 


'To study the effect of sampling on the frequency-domain quantities, we will 


sample za(t) in Example 3.17 at two different sampling frequencies. 


a. Sample za(t) at F, = 5000 sam/sec to obtain z; (n). Determine and plot 


Xi (e). 


b. Sample z;(£) at F, = 1000 sam/sec to obtain x2(n). Determine and plot 


Xa(e"). 
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Solution 
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Frequency in KHz 
FIGURE 3.11 Plots in Example 3.17 


a. Since the bandwidth of x(t) is 2KHz, the Nyquist rate is 4000 sam/sec, 
which is less than the given F,. Therefore aliasing will be (almost) nonexistent. 


% Analog Signal 

>> Dt = 0.00005; t = -0.005:Dt:0.005; xa = exp(-1000*abs(t)) ; 
% Discrete-time Signal 

>> Ts = 0.0002; n = -25:1:25; x = exp(-1000*abs (n*Ts)) ; 
¥, Discrete-time Fourier transform 

>> K = 500; k = 0:1:K; w= pi*k/K; 

>> X-x*exp(-j*n'); X = real(X); 

>> w = [-fliplr(w), w(2:K+1)]; 

>> X = [£liplr(X), X(2:K+1)]; 

>> subplot (1,1, 1) 

>> subplot (2,1,1) ;plot (t*1000,xa) ; 

>> xlabel(’t in msec.’); ylabel(’xi(n)’) 

>> title(’Discrete Signal’); hold on 

>> stem(n*Ts*1000,x); gtext(’Ts=0.2 msec’); hold off 
>> subplot (2,1,2);plot(w/pi,X); 

>> xlabel(’Frequency in pi units’); ylabel(’Xi(w)’) 

>> title(’Discrete-time Fourier Transform’) 


In the top plot in Figure 3.12 we have superimposed the discrete signal ain) 
over x(t) to emphasize the sampling. The plot of X2(e7”) shows that it is a 


scaled version (scaled by F, = 5000) of Xa(jM). Clearly there is no aliasing. 
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FIGURE 3.12 Plots in Example 3.18a 


b. Here F, — 1000 « 4000. Hence there will be a considerable amount of 
aliasing. This is evident from Figure 3.13, in which the shape of X (e^) is dif- 
ferent from that of X, (j(1) and can be seen to be a result of adding overlapping 
replicas of Xa(jM). n 


From the sampling theorem and the above examples it is clear that if we 
sample band-limited z, (f) above its Nyquist rate, then we can reconstruct 
q(t) from its samples x(n). This reconstruction can be thought of as a 
two-step process: 

e First the samples are converted into a weighted impulse train. 


oo 


DO s()é(t-nT,) = ---+2(-1)6(n-+T,)+2(0)8(6) ez (05(n- T) + 


n=—00 


e Then the impulse train is filtered through an ideal analog lowpass 
filter band-limited to the [-F/2, F,/2] band. 


Impulse train Ideal lowpass 
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FIGURE 3.13 Plots in Example 3.18b 


This two-step procedure can be described mathematically using an inter- 
polating formula [19] 


oo 


za(t)= Y. z(n)sinc[F.(t — nT.) (3.33) 


n--—oo 


where sinc(z) = #22% is an interpolating function. The physical inter- 





"TI 


pretation of the above reconstruction (3.33) is given in Figure 3.14, from 
which we observe that this ideal interpolation is not practically feasible 
because the entire system is noncausal and hence not realizable. 


Practical D/A converters In practice we need a different approach 
than (3.33). The two-step procedure is still feasible, but now we replace 
the ideal lowpass filter by a practical analog lowpass filter. Another in- 
terpretation of (3.33) is that it is an infinite-order interpolation. We want 
finite-order (and in fact low-order) interpolations. There are several ap- 
proaches to do this. 
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x(0) sinc(/,t] 


t 


+ 
x(1) sinc[F,(t — T,)] 
t 
SN Neuss 


s 


xg t) 


* | x(2) sinclF,(t — 27,)] 
t 
2T, 
t 


-T, 0 T; 217, 31, 


+ x(3) sinciF,(t — 37,)] 
Sample at 
t= nT, t 


37, 






leset 


x, (t) = X x(n) sinclF,(t — n7,)) 





IT, 0 T, 27, 37, 


Sampling Reconstruction 


FIGURE 3.14 Reconstruction of band-limited signal from its samples 


e Zero-order-hold (ZOH) interpolation: In this interpolation a given 
sample value is held for the sample interval until the next sample is re- 
ceived. 


£,(t) = x(n), nT, <n<(n+1)T, 


which can be obtained by filtering the impulse train through an interpo- 
lating filter of the form 


1 0<t<T. 
ho(t) = E 
0, otherwise 


Chapter 3 & THE DISCRETE-TIME FOURIER ANALYSIS 





MATLAB 
IMPLEMEN- 
TATION 


which is a rectangular pulse. The resulting signal is a piecewise-constant 
(staircase) waveform which requires an appropriately designed analog 
post-filter for accurate waveform reconstruction. 


z(n) — — &(t) — — as (f) 


e First-order-hold (FOH) interpolation: In this case the adjacent 
samples are joined by straight lines. This can be obtained by filtering 
the impulse train through 


i 
— <t< 
btw 0<t<T, 
m= 1-2 meteor, 
T, 
0, otherwise 


Once again an appropriately designed analog postfilter is required for 
accurate reconstruction. These interpolations can be extended to bigher 
orders. One particularly useful interpolation employed by MATLAB is the 
following. 

e Cubic spline interpolation: This approach uses spline interpolants 
for a smoother, but not necessarily more accurate, estimate of the analog 
signals between samples. Hence this interpolation does not require an 
analog postfilter. The smoother reconstruction is obtained by using a set 
of piecewise continuous third-order polynomials called cubic splines, given 
by [5] 


Ta (t) = ao (n) + e (n) (t — NTs) + az (n) (t - nT)? 
+ a3 (n) (t — nT,?, nT,€mn«(n-41)T, (3.34) 


where (o; (n),0 < i € 3) are the polynomial coefficients, which are de- 
termined by using least-squares analysis on the sample values. (Strictly 
speaking, this is not a causal operation but is a convenient one in MaT- 
LAB.) 


For interpolation between samples MATLAB provides several approaches. 
The function sinc(x), which generates the (sinmzr)/mz function, can 
be used to implement (3.33), given a finite number of samples. If 
{z (n), nı € n € nz) is given, and if we want to interpolate za (t) on 
a very fine grid with the grid interval At, then from (3.33) 


Ta (mAt) = »» z(n)sinc [F,(mAt —n7,)), tı < mAt&t; (3.35) 


n-ni 
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which can be implemented. as a matrix-vector multiplication operation as 
shown below. 


>> n = ni:n2; t = ti:t2; Fs = 1/Ts; nTs = n*Ts; X Ts is the sampling interval 
>> xa=x* ginc(Fs*(ones(length(n) ,1)*t-nTs’*ones(1,length(t)))); 


Note that it is not possible to obtain an ezact analog £a(t) in light of the 
fact that we have assumed a finite number of samples. We now demon- 
strate the use of the sinc function in the following two examples and also 
study the aliasing problem in the time domain. 


O EXAMPLE 3.19 From the samples zi(n) in Example 3.18a, reconstruct Z(t) and comment on 
the results. 





i Note that 21(n) was obtained by sampling x(t) at T, = 1 / F, = 0.0002 sec. We 
i will use the grid spacing of 0.00005 sec over —0.005 < t < 0.005, which gives 
d z(n) over —25 € n € 25. 


Solution 






! X Discrete-time Signal xi(n) 
| >> Ts = 0.0002; n = -25:1:25; nTs = n*Ts; 

>> x = exp(-1000*abs (nTs)) ; 

% Analog Signal reconstruction 

| >> Dt = 0.00005; t = -0.005:Dt:0.005; 

I >> xa = x * ginc(Fs*(ones(length(n) ,1)*t-nTs’*ones(1,length(t)))); 
| % check 

>> error = max(abs(xa - exp(-1000*abs(t)))) 

error = 
0.0363 





The maximum error between the reconstructed and the actual analog signal is 
0.0363, which is due to the fact that z(t) is not strictly band-limited (and also 
we have a finite number of samples). From Figure 3.15 we note that visually 
the reconstruction is excellent. D 
















Reconstructed Signal from x1(n) using sinc function 
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FIGURE 3.15 Reconstructed signal in Example 3.19 
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O EXAMPLE 3.20 


Solution 


O EXAMPLE 321 


Solution 


Sampling and Reconstruction of Analog Signals 


From the samples z2(n) in Example 3.18b reconstruct Za(t) and comment on 
the results. : 


In this case x2(n) was obtained by sampling Za(t) at Ts = 1/F, = 0.001 sec. We 
will again use the grid spacing of 0.00005 sec over —0.005 < t < 0.005, which 
gives x(n) over -5 <n € 5. 


4% Discrete-time Signal x2(n) 

>> Ts = 0.001; n = -5:1:5; nTs = n*Ts; 

>> x = exp(-1000*abs (nTs)) ; 

% Analog Signal reconstruction 

>> Dt = 0.00005; t = -0.005:Dt:0.005; 

>> xa =x * sinc(Fs*(ones (length (n) ,1)*t-nTs’*ones(1,length(t)))); 
% check 

>> error = max(abs(xa - exp(-1000*abs(t)))) 


error * 
0.1852 


The maximum error between the reconstructed and the actual analog signal is 
0.1852, which is significant and cannot be attributed to the nonband-limitedness 
of a(t) alone. From Figure 3.16 observe that the reconstructed signal differs 
from the actual one in many places over the interpolated regions. This is the 
visual demonstration of aliasing in the time domain. n 


The second MATLAB approach for signal reconstruction is a plotting 
approach. The stairs function plots a staircase (ZOH) rendition of the 
analog signal, given its samples, while the plot function depicts a linear 
(FOH) interpolation between samples. 


Plot the reconstructed signal from the samples z1 (n) in Example 3.18 using 
the ZOH and the FOH interpolations. Comment on the plots. 


Note that in this reconstruction we do not compute za (t) but merely plot it 
using its samples. 


Reconstructed Signal from x2(n) using sinc function 


— 





xa(t) 











FIGURE 3.16 Reconstructed signal in Example 3.20 


























n 


4 Discrete-time Signal xi(n) : Ts = 0.0002 

>> Ts = 0.0002; n = -25:1:25; nTs = n*Ts; 

>> x = exp(-1000*abs(nTs)); 

% Plots 

»» subplot(2,1,1); stairs(nTs*1000,x); 

>> xlabel(?t in msec.'); ylabel(’xa(t)’) 

»» title('Reconstructed Signal from xi(n) using zero-order-hold’); hold on 
»» stem(n*Ts*1000,x); hold off 

* 

% Discrete-time Signal x2(n) : Ts = 0.001 

>> Ts = 0.001; n = -5:1:5; nTs = n*Ts; 

>> x = exp(-1000*abs(nTs)); 

% Plots 

»» subplot(2,1,2); stairs(nTs*1000,x); 

>> xlabel(^t in msec.’); ylabel(’xa(t)’) 

>> title(’Reconstructed Signal from x2(n) using zero-order-hold’); hold on 
>> stem(n*Ts*1000,x); hold off 


The plots are shown in Figure 3.17, from which we observe that the ZOH re- 
construction is a crude one and that the further processing of analog signal is 
necessary. The FOH reconstruction appears to be a good one, but a careful 
observation near t = 0 reveals that the peak of the signal is not correctly repro- 








tin msec. 





tin msec. 


FIGURE 3.17 Signal reconstruction in Example 3.21 
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O EXAMPLE 3.22 


Solution 


duced. In general, if the sampling frequency is much higher than the Nyquist 
rate, then the FOH interpolation provides an acceptable reconstruction. Dn 


The third approach of reconstruction in MATLAB involves the use of 
cubic spline functions. The spline function implements interpolation be- 
tween sample points. It is invoked by xa = spline (nTs,x,t),in which x 
and nTs are arrays containing samples x(n) at nT, instances, respectively, 
and t array contains a fine grid at which z,(t) values are desired. Note 
once again that it is not possible to obtain an ezact analog Ta(t). 


From the samples zi(n) and z2(n) in Example 3.18, reconstruct Za(t) using 
the spline function. Comment on the results. 


This example is similar to Examples 3.19 and 3.20. Hence sampling parameters 
are the same as before. 


% a) Discrete-time Signal xi(n): Ts = 0.0002 
>> Ts = 0.0002; n = -25:1:25; nTs = n*Ts; 

>> x = exp(-1000*abs (nTs)) ; 

% Analog Signal reconstruction 

>> Dt = 0.00005; t = -0.005:Dt:0.005; 

>> xa = spline(nTs,x,t); 

% check 

>> error = max(abs(xa - exp(-1000*abs(t)))) 
error = 0.0317 


The maximum error between the reconstructed and the actual analog signal 
is 0.0317, which is due to the nonideal interpolation and the fact that zo (t) 
is nonband-limited. Comparing this error with that from the sinc (or ideal) 
interpolation, we note that this error is lower. The ideal interpolation gener- 
ally suffers more from time-limitedness (or from a finite number of samples). 
From the top plot in Figure 3.18 we observe that visually the reconstruction is 
excellent. 


% Discrete-time Signal x2(n): Ts = 0.001 
>> Ts = 0.001; n = -5:1:5; nTs = n*Ts; 

>> x = exp(-1000*abs(nTs)); 

% Analog Signal reconstruction 

>> Dt = 0.00005; t = -0.005:Dt:0.005; 

>> xa = spline(nTs,x,t); 

% check 

>> error = max(abs(xa - exp(-1000*abs(t)))) 
error = 0.1679 


The maximum error in this case is 0.1679, which is significant and cannot be 
attributed to the nonideal interpolation or nonband-limitedness of za(t). From 
the bottom plot in Figure 3.18 observe that the reconstructed signal again differs 
from the actual one in many places over the interpolated regions. a 


ES 
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FIGURE 3.18 Reconstructed signal in Example 3.22 


From these examples it is clear that for practical purposes the spline 
interpolation provides the best results. 


PROBLEMS 


P3.1 


Write a MATLAB function to compute the DTFT of a finite-duration sequence. The format 
of the function should be 


function [X] = dtft(x,n,v) 
% Computes Discrete-time Fourier Transform 
X [X] = dtft(x,n,w) 


= DTFT values computed at w frequencies 
finite duration sequence over n 

= sample position vector 

= frequency location vector 


= 
*X B Mox 
n 


Use this function to compute the DTFT in the following problems (wherever required). 
For each of the following sequences, determine the DTFT X (e^). Plot the magnitude and 
angle of X (e). 


A ————————————————————M 


14 
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P3.3 


P3.4 


P3.5 


P3.6 


P3.7 


P3.8 


a. x(n) = 2(0.8)" [u (n) — u (n — 20)] 
b. z (n) = n (0.9)" [u (n) — u (50)] 
c. z (n) = (4,3,2,1,2,3, 4). Comment on the angle plot. 
T 
d. x(n) = (4,3,2,1,1,2,3, 4). Comment on the angle plot. 
T 
e. z (n) = (4,3,2,1,0, —1, —2, —3, —4). Comment on the angle plot. 
1 
f. z (n) = (4,3,2,1, —1, —2, —3, 4). Comment on the angle plot. 
t 
Determine analytically the DTFT of each of the following sequences. Plot the magnitude 
and angle of X (e) using MATLAB. 
a. z (n) = 3 (0.9)? u (n) 
b. z (n) 2 2(0.8)"*? u(n — 2) 
c. z(n) = n (0.5)" u (n) 
d. z(n) = (n + 2) (0.7)! u (n — 2) 
e. x(n) = 5(—0.9)" cos (0.1rn) u (n) 
A symmetric rectangular pulse is given by 
1, -N<n<N 
0, otherwise 


Ry (n) = { 


Determine the DTFT for N = 5, 15, 25, 100. Scale the DTFT so that X (e/?) = 1. Plot the 
normalized DTFT over [—1, 7]. Study these plots and comment on their behavior as a 
function of N. 


Repeat Problem 3.4 for a symmetric triangular pulse that is given by 


Ini 


TN (n) = |: _ Hl Rn (n) 
Repeat Problem 3.4 for a symmetric raised cosine pulse that is given by 
Cw (n) = [os + 0.5 cos (&)] Rx (n) 


A complex-valued sequence z (n) can be decomposed into a conjugate symmetric part 
Te (n) and a conjugate-antisymmetric part z, (n) as discussed in Chapter 2. Show that 
F ze (1)) = Xa (e) and =F [zo(n)] 2 jX1i (e^) 
where Xr (e^) and Xr (e^) are the real and imaginary parts of the DTFT X (e/"), 
respectively. Verify this property on 
z (n) = e/?1*" [u (n) — u (n — 20)] 
using the MATLAB functions developed in Chapter 2. 


A complex-valued DTFT X (e) can also be decomposed into its conjugate-symmetric 
part Xe (e^) and conjugate-antisymmetric part Xo (e); that is, 


x (e^) = x. (e) + Xo (e") 


———————————— —————— "CU ——— ÓÓ CÓ S!ÜÓÓ 
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P3.9 


P3.10 


P3.11 


P3.12 


P3.13 


76 





where 
X(+ (e) oma xo () = $ [x (H) xn (*)] 
Show that 
F[Xe(e*)] =2a(n) and F [Xo (*)] = 2r (0) 
where zp (n) and x; (n) are the real and imaginary parts of x(n). Verify this property on 
z (n) = e*!*" [u (n) - u (n — 20)] 


using the MATLAB functions developed in Chapter 2. 
Using the frequency-shifting property, show that the DTFT of a sinusoidal pulse 


z (n) = (coswon) Rn (n) 


is given by 


x (e) : Ere wa] P 1 [Stem] 


sin {(w — wq) /2} 2 | sin {(w + wo) /2} 
where Rw (n) is the rectangular pulse given in Problem 3.4. 


Compute and plot X (e) for wo = 7/2 and N = 5, 15, 25, 100. Use the plotting interval 
[77,7]. Comment on your results. 


Let z (n) — Tio (n) be a triangular pulse given in Problem 3.5. Using properties of the 
DTFT, determine and plot the DTFT of the following sequences. 


a. x(n) = Tio (~-n) 

. z (n) = Tio (n) — Tio (n — 10) 

. z(n) = Tio (n) * Tio (~n) 

. z (n) = Tio (n) "^ 

. z (n) = Tio (n) - Tio (n) 

For each of the linear timé-invariant systems described by the impulse response, determine 
the frequency response function H (e) and plot the magnitude response |H (e) and 
the phase response ZH (e/"). 


. h(n) = (0.9)!^! 


o 0o c 


a 

b. h(n) = sinc (0.2n) [u (n + 20) — u (n — 20)], where sinc 0 = 1. 
c. h(n) = sinc (0.2n) [u (n) — u (n — 40)] 

d. h(n) = [(0.5)” + (0.4)"] u (n) 


e. h(n) = (0.5)! cos (0.121) 


Let z (n) = 3cos (0.5zn + 60°) + 2sin (0.377) be the input to each of the systems described 
in Problem 3.11. In each case determine the output y (n). 


An ideal lowpass filter is described in the frequency domain by 


1-6-7", lw| Swe 


Ha (=) m t we < w| E v 


where we is called the cutoff frequency and a is called the phase delay. 
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P3.14 


P3.15 


P3.16 


a. Determine the ideal impulse response ha (n) using the IDTFT relation (3.2). 
b. Determine and plot the truncated impulse response 

h , O<n<N-1 

o bald 

0, otherwise 
for N = 41, a = 20, and we = 0.57. 
c. Determine and plot the frequency response function H (e) and compare it with the 
ideal lowpass filter response Ha (e^). Comment on your observations. 
An ideal highpass filter is described in the frequency domain by 


1:e7?", we < wl € v 


He (e) = y 


where we is called the cutoff frequency and a is called the phase delay. 
a. Determine the ideal impulse response ha (n) using the IDTFT relation (3.2). 
b. Determine and plot the truncated impulse response 
ha(n, O<n<N-1 
pinya [A OEE 
0, otherwise 


lw] Swe 


for N = 31, a = 15, and we = 0.57. 
c. Determine and plot the frequency response function H (e) and compare it with the 
ideal highpass filter response Ha (e). Comment on your observations. 
For a linear time-invariant system described by the difference equation 
M N 
y(n) = > bna (n m) - 9 aw (n - £ 
m=0 t=1 


the frequency response function is given by 


M = 
w (eh) Ze 
1+ Y aí,e-j»* 


Write a MATLAB function freqresp to implement the above relation. The format of this 
function should be 


function [H] = freqresp(b,a,w) 

% Frequency response function from difference equation 

% [H] = freqresp(b,a,w) 

= frequency response array evaluated at w frequencies 
numerator coefficient array 

denominator coefficient array (a(1)=1) 

frequency location array 


$2 
apo x 
a 


Determine H (e*”) and plot its magnitude and phase for each of the following systems. 


a. y(n) = mao (n - m) 
b. y(n) = z(n) + 2z(n - 1) + z (n — 2) — 0.5y (n — 1) — 0.25y (n — 2) 


A 
Ti 


Problems 














P317 


P3.18 


P3.19 


P3.20 


0 


c. y(n) = 2z (n) + z (n — 1) - 0.25y (n — 1) + 0.25y (n — 2) 

d. y(n) 2 z(n) - z(n - 2) — 0.81y (n — 2) 

e. y(n) = z (n) - Eem (0.9! v(n - £ 

A linear time-invariant system is described by the difference equation 


3 3 

y(n) = So z(n- 2m) - Y (0.81) y(n — 26) 

m=0 f=1 

Determine the steady-state response of the system to the following inputs: 
a. a(n) 2 54 10(-1)" 
b. a(n) = 1 + cos (0.5mn + 1/2) 
c. a(n) = 2sin (7n/4) + 3cos (31/4) 
d. z(n) = Epo (k + 1) cos (mkn/A) 
e. z (n) = cos (n) 
In each case generate z (n), 0 < n < 200 and process it through the filter function to 
obtain y (n). Compare your y (n) with the steady-state responses in each case. 


An analog signal za (t) = sin (1000mt) is sampled using the following sampling intervals. In 
each case plot the spectrum of the resulting discrete-time signal. 

a. T, — 0.1 ms 

b. T; = 1 ms 

c. T, = 0.01 sec 

We have the following analog filter, which is realized using a discrete filter. 


za () [A/D] P [ne] 9 [D/A] — v. 0 


The sampling rate in the A/D and D/A is 100 sam/sec, and the impulse response is 

h(n) = (0.5)" u (n). 

a. What is the digital frequency in z (n) if za (t) = 3cos (20nt)? 

b. Find the steady-state output yo (t) if £a (t) = 3cos (20nt). 

c. Find the steady-state output ya (t) if £a (t) = 3u (t). 

d. Find two other analog signals £a (t), with different analog frequencies, that will give the 
same steady-state output ya (t) when £a (t) = 3cos (20rt) is applied. 

e. To prevent aliasing, a prefilter would be required to process Ta (t) before it passes to the 
A/D converter. What type of filter should be used, and what should be the largest cutoff 
frequency that would work for the given configuration? 

Consider an analog signal £a (t) = sin(20mt), 0 < t € 1. It is sampled at T, = 0.01, 0.05, 
and 0.1 sec intervals to obtain z (n). 


a. For each T, plot z (n). 


b. Reconstruct the analog signal ya (t) from the samples x (n) using the sinc interpolation 
(use At — 0.001) and determine the frequency in ya (t) from your plot. (Ignore the end 
effects.) 


a TTT 
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c. Reconstruct the analog signal ya (t) from the samples z (n) using the cubic spline 
interpolation and determine the frequency in ya (t) from your plot. (Ignore the end effects.) 
d. Comment on your results. 

Consider the analog signal £a (t) = sin (20rt + 1/4), 0 X t € 1. It is sampled at T, = 0.05 
sec intervals to obtain z (n). 

a. Plot £a (t) and superimpose z (n) on it using the plot (n,x,'o?) function. 

b. Reconstruct the analog signal ya (t) from the samples x (n) using the sinc interpolation 
(use At = 0.001) and superimpose £ (n) on it. 

c. Reconstruct the analog signal ya (t) from the samples x (n) using the cubic spline 
interpolation and superimpose z (n) on it. 

d. You should observe that the resultant reconstruction in each case has the correct 
frequency but a different amplitude. Explain this observation. Comment on the role of 
phase of Ta (t) on sampling and reconstruction of signals. 


oe we Se ae 
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THE Z-TRANSFORM 


In Chapter 3 we studied the discrete-time Fourier transform approach for 
representing discrete signals using complex exponential sequences. This 
representation clearly has advantages for LTI systems because it describes 
systems in the frequency domain using the frequency response function 
H (e^). The computation of the sinusoidal steady-state response is greatly 
facilitated by the use of H (e/"). Furthermore, response to any arbitrary 
absolutely summable sequence z(n) can easily be computed in the fre- 
quency domain by multiplying the transform X (e^) and the frequency 
response H(e/"). However, there are two shortcomings to the Fourier 
transform approach. First, there are many useful signals in practice— 
such as u(n) and nu(n)—for which the discrete-time Fourier transform 
does not exist. Second, the transient response of a system due to ini- 
tial conditions or due to changing inputs cannot be computed using the 
discrete-time Fourier transform approach. 

Therefore we now consider an extension of the discrete-time Fourier 
transform to address the above two problems. This extension is called the 
z-transform. Its bilateral (or two-sided) version provides another domain 
in which a larger class of sequences and systems can be analyzed, while its 
unilateral (or one-sided) version can be used to obtain system responses 
with initial conditions or changing inputs. 


THE BILATERAL z-TRANSFORM 
— —— 


The z-transform of a sequence x(n) is given by 
oo 


X()2Z|r(n])- Y, zz (41) 


n=—o0o 


where z is a complex variable. The set of z values for which X(z) exists 
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EXAMPLE 4.1 


is called the region of convergence (ROC) and is given by 
Ra- < |z| < Ret (4.2) 


for some positive numbers Rz- and R,+. 
The inverse z-transform of a complex function X (z) is given by 


z(n) 4371 [X(z)] = ij jxone (4.3) 


where C is a counterclockwise contour encircling the origin and lying in 
the ROC. 


Comments: 


1. The complex variable z is called the complez frequency given by 
z = |z| e", where |z| is the attenuation and w is the real frequency. 

2. Since the ROC (4.2) is defined in terms of the magnitude |z|, the 
shape of the ROC is an open ring as shown in Figure 4.1. Note that Rz- 
may be equal to zero and/or R, could possibly be oo. 

3. If Rey < Re-, then the ROC is a null space and the z-transform 
does not exist. 

4. The function |z| = 1 (or z = ef”) is a circle of unit radius in the 
z-plane and is called the unit circle. If the ROC contains the unit circle, 
then we can evaluate X (2) on the unit circle. 


oo 


X(2)zu« = X(e") Y zine = Fla(n)] 


n=- 


Therefore the discrete-time Fourier transform X (e?) may be viewed as 
a special case of the z-transform X (z). 


Let x(n) = a"u(n), 0 < |a| < oo. (This sequence is called a positive-time 
sequence). Then 





FIGURE 4.1 A general region of convergence 
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FIGURE 4.2 The ROC in Example 4.1 


nasere (2) = pope |: 
0 0 


- LE iz| > lal = ROC: lal < |z| <.co 
Rz£- Rz 
Note: X(z) in this example is a rational function; that is, 


^B(z2) z 
Xi) = A(z) z-a 








where B(z) = z is the numerator polynomial and A(z) = z—a is the denominator 
polynomial. The roots of B(z) are called the zeros of X (z), while the roots of 
A(z) are called the poles of X(z). In this example X, (z) has a zero at the origin 
z = 0 and a pole at z = a. Hence z1(n) can also be represented by a pole-zero 
diagram in the z-plane in which zeros are denoted by ‘o’ and poles by ‘x’ as 
shown in Figure 4.2. n 


n EXAMPLE 4.2 Let z;(n) = —b"u(—n—1), 0 < |b| < oo. (This sequence is called a negative-time 
sequence.) Then 


X2o(z) =- y bz™ = $ eY 








oo oo 
--Y(0' -1-X(t) 

1 0 
ojo =, ROC: 0 «jd 
| izb z-V a ed FISILE 


Re Rey 


The ROC; and the pole-zero plot for this z2(n) are shown in Figure 4.3. 


Imtz) 


Retz) 





FIGURE 4.3 The ROC in Ezample 4.2 
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Note: If} =a in this example, then X2(z) = X1(z) except for their respective 
ROCs; that is, ROC: # ROC». This implies that the ROC is a distinguishing 
feature that guarantees the uniqueness of the z-transform. Hence it plays a very 
important role in system analysis. o 


n EXAMPLE 43 Let x3(n) = zi(n) + 22(n) = a"^u(n) — b"u(—n — 1) (This sequence is called a 
two-sided sequence.) Then using the above two examples, 


oo -1 


X3(z) = ya" - wet 


n=0 —oo 


z z 


- (aoo: lal > lal) + { 5, R00: lel < il) 


z z 
morer kam 








ROCs: ROC; N ROC? 








If |b] < Jal, the ROCs is a null space and X3(z) does not exist. If jal < jbl, 
then the ROCs is |a] < |z| < |b| and Xs(z) exists in this region as shown in 
Figure 4.4. n 


PROPERTIES From the observation of the ROCs in the above three examples, we state 
OF THE ROC the following properties. 


1. The ROC is always bounded by a circle since the convergence 
condition is on the magnitude |z|. 

2. The sequence z1(n) = a"u(n) in Example 4.1 is a special case of 
a right-sided sequence, defined as a sequence z(n) that is zero for some 
n < no. From Example 4.1 the ROC for right-sided sequences is always 
outside of a circle of radius R,—. If no > 0, then the right-sided sequence 
is also called a causal sequence. 

3. The sequence z;(n) = —b"u(—n — 1) in Example 4.2 is a special 
case of a left-sided sequence, defined as a sequence x(n) that is zero for 
some n > no. If no < 0, the resulting sequence is called an anticausal 
sequence. From Example 4.2 the ROC for left-sided sequences is always 
inside of a circle of radius R,+. 


Im{z} 


e X. 





Retz) 


t 


FIGURE 4.4 The ROC in Example 4.3 
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4. The sequence z3(n) in Example 4.3 is a two-sided sequence. The 
ROC for two-sided sequences is always an open ring Rz- < |z| < Rz 
if it exists. 

5. The sequences that are zero for n < nı and n > nz are called 
finite-duration sequences. The ROC for such sequences is the entire z- 
plane. If nı < 0, then z = oo is not in the ROC. If nz > 0, then z = 0 is 
not in the ROC. 

6. The ROC cannot include a pole since X (z) converges uniformly 
in there. : 

7. There is at least one pole on the boundary of a ROC of a rational 
X(z). 

8. The ROC is one contiguous region; that is, the ROC does not come 
in pieces. 


In digital signal processing, signals are assumed to be causal since 
almost every digital data is acquired in real time. Therefore the only 
ROC of interest to us is the one given in 2 above. 


IMPORTANT PROPERTIES OF THE z-TRANSFORM 
—_——______—___—_—_- 


The properties of the z-transform are generalizations of the properties 
of the discrete-time Fourier transform that we studied in Chapter 3. We 
state the following important properties of the z-transform without proof. 


1. Linearity: 


Z [ayzi(n) + aoxa(n)] = a1 Xi(z) + a2X2(z); ROC: ROC;, NROCz, 


(4.4) 
2. Sample shifting: 
Z|r(n-no) =2z7™X(z); ROC: ROC, (4.5) 
3. Frequency shifting: 
Z{a"z(n)] = X (2); ROC: ROC, scaled by Ja — (49) 
4. Folding: 
Z[r(-n)- X(1/z2; ROC: Inverted ROC, (4.7) 
5. Complex conjugation: 
Z[r'(n) = X*(2"); ROC: ROC, (4.8) 
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6. Differentiation in the z-domain: 
Z [nz(n)] = =O), ROC: ROC, (4.9) 


This property is also called “multiplication by a ramp” property. 
7. Multiplication: 
Z [zi (n)z2 (n)] = ES f Xi (v) Xo (z/v) vdv; (4.10) 
21j Jc 
ROC: ROC,, N Inverted ROC;, 


where C is a closed contour that encloses the origin and lies in the common 
ROC. 


8. Convolution: 
Z [zi(n) * xo(n)] = Xi(2)X2(z); ROC: ROC, n ROC, (411) 


This last property transforms the time-domain convolution operation 
into a multiplication between two functions. It is a significant property 
in many ways. First, if X1(z) and X2(z) are two polynomials, then their 
product can be implemented using the conv function in MATLAB. 


Let Xi(z) 2 2-327! +427? and X2(z) =3+ 42^! +527? +. 62 ?. Determine 
X3(z) = Xi(z)Xa(2). 


From the definition of the z-transform we observe that 


zi(n) = {2,3,4} and za(n) = {3,4,5,6} 
T T 


Then the convolution of the above two sequences will give the coefficients of the 
required polynomial product. 


>> xi = [2,3,4]; x2 = [3,4,5,6]; 
>> x3 = conv(x1,x2) 
x3 = 6 17 34 43 38 24 


Hence 
Xs(z) =6 + 1727! +3427? + 432? 4 882 5 + 24z 5 


Using the conv.m function developed in Chapter 2, we can also multiply 
two z-domain polynomials corresponding to noncausal sequences. o 


Let Xı(z) =z 4-2-F3z^! and X2(2) = 22? +4z -3-- 52^. Determine X3(z) = 
X1(z)Xa(z). 


a T 
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Solution 





Note that 


zi(n) = {1,2,3} and a(n) = {2, 4,3,5} 
T T 
Using MATLAB, 


>> xt = [1,2,3]; ni = [-1:1]; 
>> x2 = [2,4,3,5]; n2 = [-2:1); 
>> [x3,n3] = conv m(xi,ni,x2,n2) 
x3 = j 


Xa(z) = 225 + 82? + 17z +23 + 192^! + 1527? D 


In passing we note that to divide one polynomial by another one, we 
would require an inverse operation called deconvolution [19, Chapter 6]. 
In MATLAB [p,r] = deconv(b,a) computes the result of dividing b by 
a in a polynomial part p and a remainder r. For example, if we divide the 
polynomial X3(z) in Example 4.4 by X;(z), 


>> x3 = [6,17,34,43,38,24]; x1 = (2,3,4]; 
>> [x2,r] = deconv(x3,x1) 
x2 = 

3 4 5 6 


0 0 0 0 0 0 


then we obtain the coefficients of the polynomial X2(z) as expected. To 
obtain the sample index, we will have to modify the deconv function 
as we did in the conv.m function. This is explored in Problem 4.8. This 
operation is useful in obtaining a proper rational part from an improper 
rational function. 

The second important use of the convolution property is in system 
output computations as we shall see in a later section. This interpreta- 
tion is particularly useful for verifying the z-transform expression X (z) 
using MATLAB. Note that since MATLAB is a numerical processor (unless 
the Symbolic toolbox is used), it cannot be used for direct z-transform 
calculations. We will now elaborate on this. Let z(n) be a sequence with 
a rational transform 


B(z) 
A(z) 





X(z)= 
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where B(z) and A(2) are polynomials in z^!. If we use the coefficients of 
B(z) and A(z) as the b and a arrays in the filter routine and excite this 
filter by the impulse sequence ó(n), then from (4.11) and using Z [6 (n)] = 
1, the output of the filter will be z(n). (This is a numerical approach of 
computing the inverse z-transform; we will discuss the analytical approach 
in the next section.) We can compare this output with the given x(n) to 
verify that X(z) is indeed the transform of a(n). This is illustrated in 


Example 4.6. 
SOME Using the definition of z-transform and its properties, one can determine 
COMMON z-transforms of common sequences. A list of some of these sequences is 
z-TRANSFORM given in Table 4.1. 


PAIRS 


o EXAMPLE 4.6 Using z-transform properties and the z-transform table, determine the z- 
transform of 


a(n) = (n — 2)(0.5) ^? cos [Fo m 2] u(n — 2) 


TABLE 4.1 Some common z-transform pairs 


Sequence Transform ROC 
6(n) 1 Vz 
u(n) Du ld» 1 

—u(—n - 1) woo lj «1 
a^u(n) Dus la > lal 
~b*u(—n— 1) Du lal < Ibl 


(asinwo)z * 


[a^ sin on] u(n) T= Qacosub)z-i + az? |z| > lel 
[a^ cos won] u(n) ae |z| > le] 

na"u(n) cR |2] > lal 
—nb^u(—n — 1) cR \z| < bi 


E —————— 
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Solution Applying the sample-shift property, 


7n 


X(z) = Zls(n) = 272 [n(0.5)" cos (=) u(n)| 
with no change in the ROC. Applying the multiplication by a ramp property, 


xe e [eere n 


with no change in the ROC. Now the z-transform of (0.5)” cos ($n) u(n) from 


Table 4.1 is 
Z [0.57 cos (=) um) = ma te |z| > 0.5 
"i-e mer Moos 
Hence 
[ette n 


_ 0.25273 — 0.5274 + 0.06252 7 
= 1z 140.757? — 0.252-3 + 0.06252~4’ 





|z| > 0.5 


MATLAB verification: To check that the above X(z) is indeed the correct ex- 
pression, let us compute the first 8 samples of the sequence z(n) corresponding 
to X(z) as discussed before. 


>> b= (0,0,0,0.25,-0.5,0.0625] ; a = [1,-1,0.75,-0.25,0.0625]; 
>> (delta,n]=impseq(0,0,7) 
delta = 
i 0 0 0 0 0 o 0 
n= 
0 1 2 3 4 5 6 7 
>> x = filter(b,a,delta) % check sequence 
x= 
Columns 1 through 4 
0 0 0 0.25000000000000 
Columns 5 through 8 
-0.25000000000000 -0.37500000000000 -0.12500000000000 0.07812500000000 
>> x = [(n-2).*(1/2) .^ (n-2) .*cos(pi*(n-2)/3)] .*stepseq(2,0,7) % original sequence 
xc 
Columns 1 through 4 
0 [" 0 0.25000000000000 


Llc (xo UA Roi ee 
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Columns 5 through 8 
-0.25000000000000 -0.37500000000000 -0.12500000000000 0.07812500000000 


This approach can be used to verify the z-transform computations. g 


INVERSION OF THE z-TRANSFORM 
—— ————————8——— 


From definition (4.3) the inverse z-transform computation requires an 
evaluation of a complex contour integral that, in general, is a complicated 
procedure. The most practical approach is to use the partial fraction ex- 
pansion method. It makes use of the z-transform Table 4.1 (or similar 
tables available in many textbooks.) The z-transform, however, must be 
a rational function. This requirement is generally satisfied in digital signal 
processing. 


Central Idea: When X(z) is a rational function of z-l, it can be ex- 
pressed as a sum of simple (first-order) factors using the partial fraction 
expansion. The individual sequences corresponding to these factors can 
then be written down using the z-transform table. 

The inverse z-transform procedure can be summarized as follows: 


Method: Given 


bo + biz Tc buz-M 


X = 
(2) 1Ha! anz 


Rs- < jz| < Rey (4.12) 
e express it as 


by + biz ipee + by_y27 ND MEN 
xij eee e 
Ll+ayz-}4---+anz7 rar 
X — 

Proper rational part polynomial part if M>N 
where the first term on the right-hand side is the proper rational part 
and the second term is the polynomial (finite-length) part. This can be 
obtained by performing polynomial division if M 2 N using the deconv 
function. 

e perform a partial fraction expansion on the proper rational part of 
X(z) to obtain 





N Ry M-N 
m —k 
Ee d Yos (4.13) 
k=1 k=0 
M>N 
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where p, is the kth pole of X(z) and Ry is the residue at pp. It is assumed 


that the poles are distinct for which the residues are given by 


R= bo + bz! Te bu iz (7D 
: lcraiz4---ayz-N 





(17 pk) 


2=Pk 


For repeated poles the expansion (4.13) has a more general form. If a pole 


px has multiplicity r, then its expansion is given by 


£5ü-pz1) pee?” Q-p»z?) -pzy 
(4.14) 


where the residues Rx, are computed using a more general formula, which 
is available in [19]. 
e write x(n) as 


N 1 M-N 
LU a d 
a(n) = Do Rez [a+ 2, 0n k) 


— 
M2N 


e finally, use the relation from Table 4.1 


apa of ree) o das Re 
* [aen wee. S 





to complete x(n). 


a EXAMPLE 4.7 Find the inverse z-transform of z(z) = 3 





z2?—4z41l 
Solution Write 
1,-1 
z iz 
X(z)= = 3 
(2) 3(z2 — 4z + 3) 1- 4z-!4+ 427? 
1,-1 1 1 
mew e aaa eae eee Le 
(1-2-73)0 - 3277) 1-z 1-iz! 


or 


Now, X (z) has two poles: zı = 1 and zz = 3; and since the ROC is not specified, 
there are three possible ROCs as shown in Figure 4.5. 


A Tees 
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MATLAB 
IMPLEMEN- 
TATION 


Imtz Im{z} Im{z} 


ale Re{z} Retz Reiz) 
Ge /3 1 


ROC; ROC; 


FIGURE 4.5 The ROCs in Example 4.7 


a. ROCi: 1 < |z| < oo. Here both poles are on the interior side of the 
ROC); that is, |z1| < Rz- = 1 and |z2| € 1. Hence from (4.15) 


1 1/i\" 
zin) = zun) - 5 (5) u(n) 
which is a right-sided sequence. 
b. ROC2: 0 < |z| < i. Here both poles are on the exterior side of the 
ROC;; that is, |n] > Re+ = $ and [z2| 2 1. Hence from (4.15) 


za(n) = 1 {-u(—n - )) - 3 {- (3) u(n- 1) 
- ; (5) «c» -1)- jun -1) 


which is a left-sided sequence. 

c. ROCs: } < |z| < 1. Here pole zı is on the exterior side of the ROC3— 
that is, }z1| > Rz+ = 1—while pole 22 is on the interior side—that is, |z2| < 3. 
Hence from (4.15) 


z3(n) = -jucn -1)- 5 (5) um) 


which is a two-sided sequence. n 


A MATLAB function residuez is available to compute the residue part 
and the direct (or polynomial) terms of a rational function in z^. Let 





bg-Fbiz 1 4 buz M — B(z) 
aot az l+ tanz A(z) 


N Ri M-N 

= —— + Ciz ® 
> = y» 
kil Pes k=0 


X(z) = 


M2N 


be a rational function in which the numerator and the denominator poly- 
nomials are in ascending powers of z^. Then (R,p,Cl-residuez (b,a) 


aag SS SS C AE E 
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a EXAMPLE 4.8 


Solution 





finds the residues, poles, and direct terms of X (z) in which two poly- 
nomials B(z) and A(z) are given in two vectors b and a, respectively. 
The returned column vector R contains the residues, column vector p 
contains the pole locations, and row vector C contains the direct terms. 
If p(k)=...=p(ktr-1) is a pole of multiplicity r, then the expansion in- 
cludes the term of the form 


Ry Resi isc Rk+r-1 
1— pez  (1- pez!) (1 — pez?) 





(4.16) 


which is different from (4.14). 

Similarly, [b,a]=residuez(R,p,C), with three input arguments and 
two output arguments, converts the partial fraction expansion back to 
polynomials with coefficients in row vectors b and a. 


To check our residue functions, let us consider the rational function 


z 
XRS 3z2 —4z +1 


given in Example 4.7. 


First rearrange X (z) so that it is a function in ascending powers of z^. 


zt 0crz! 


eus 324z i 4z 3-4 4z3 


Now using MATLAB, 


>> b = [0,13; a = [3,-4,1]; 
>> [R,p,C] = residuez(b,a) 


R= 
0.5000 
-0.5000 
p= 
1.0000 
0.3333 
c= 
g 
we obtain 


1 


1 
= 2 2 
«re 1-z3 1-iz! 


as before. Similarly, to convert back to the rational function form, 


>> [b,a] = residuez(R,p,C) 
b= 

0.0000 

0.3333 


ST 
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a 


EXAMPLE 4.9 


a= 
1.0000 
-1.3333 
0.3333 
so that 
x@)=—P Ys a eee 
“yo ft 4 he? 3—42-1 42-2 322 -—4z4+1 
as before. D 


Compute the inverse z-transform of 


X(z) = |z| > 0.9 


1 
(1 —0.92-1)? (1 + 0.9271)’ 


We can evaluate the denominator polynomial as well as the residues using MAT- 
LAB. 


>> b = 1; a = poly([0.9,0.9,-0.9]) 
a= 
1.0000 -0.9000 -0.8100 0.7290 

>> [R,p,C]=residuez(b,a) 
R= 

0.2500 

0.5000 

0.2500 

0.9000 

0.9000 

-0.9000 
a } 


ü 


Note that the denominator polynomial is computed using MATLAB's polynomial 
function poly, which computes the polynomial coefficients, given its roots. We 
could have used the conv function, but the use of the poly function is more 
convenient for this purpose. From the residue calculations and using the order 
of residues given in (4.16), we have 


0.25 0.5 0.25 


XG)-i-g9;i* Googe? 10971 


|z} > 0.9 


0.25 o5 (0927) 0.25 
= T0921 *09'(-0973) 13097" lel > 09 


OF 
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Hence from Table 4.1 and using the z-transform property of time-shift, 
x(n) = 025 (0.9)" u(n) + Š (n + 1) (0.9)"*+ u(n + 1) + 0.25 (-0.9)" u(n) 
which upon simplification becomes 
x(n) = 0.75 (0.9)" u(n) + 0.5n (0.9)" u(n) + 0.25 (—-0.9)" u(n) 


MATLAB verification: 


>> [delta,n] = impseq(0,0,7); 
>> x = filter(b,a,delta) % check sequence 


x= 


Columns 1 through 4 


1.00000000000000 0.90000000000000 1.62000000000000 1.45800000000000 


Columns 5 through 8 


1.96830000000000 1.77147000000000 2.12576400000000 1.91318760000000 


>> x = (0.75)*(0.9).^n + (0.5)*n.*(0.9).^n + (0.25)*(-0.9).^n X answer sequence 


x= 


Columns 1 through 4 


1.00000000000000 0.90000000000000 1.62000000000000: 1.45800000000000 


Columns 5 through 8 


1.96830000000000 1.77147000000000 2.12576400000000 1.91318760000000 n 


C EXAMPLE 4.10 Determine the inverse z-transform of 


Solution 


X(z) = 140.4227! 
1— 0.8/2z-! + 0.64z-? 


so that the resulting sequence is causal and contains no complex numbers. 


We will have to find the poles of X(z) in the polar form to determine the ROC 
of the causal sequence. . 


>> b = [1,0.4*sqrt(2)]; a=[1,-0.8*sqrt(2),0.64]; 
>> [R,p,C] = residuez(b,a) 
R= 

0.5000 - 1.0000i 

0.5000 + 1.0000i 

0.5657 + 0.5657i 

0.5657 - 0.5657i 
C= 

D 

>> Mpsabs(p’) % pole magnitudes 
Mp = 

0.8000 0.8000 
>> Ap=angle(p’)/pi 4 pole angles in pi units 
Ap = 

-0.2500 0.2500 
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From the above calculations 
0.54-j 0.5—j 


X(z) = ——253 + — 
(27 palette ' 1-]o.8|e/ 12 


|z| > 0.8 


and from Table 4.1 we have f 
z(n) = (0.5 + j) |0.8[" e 5^u(n) + (0.5 — 3) |0.8|" e Í^u(n) 
= jos]" [0.5 («717 + 817) + j (e^ i") utm) 


= jo.8I" [cos (3) +2sin (=) u(n) 
MATLAB verification: 


>> [delta, n] = impseq(0,0,6); 
>> x = filter(b,a,delta) % check sequence 
x= 
Columns 1 through 4 
1.00000000000000 1.69705627484771 1.28000000000000 0.36203867196751 
Columns 5 through 8 
-0.40960000000000 -0.69511425017762 -0.52428800000000 -0.14829104003789 
>> x = ((0.8).^n).*(cos(pi*n/4)*2*sin(pi*n/4)) 
x= 
Columns 1 through 4 
1.00000000000000 1.69705627484771 1.28000000000000 0.36203867196751 
Columns 5 through 8 
-0.40960000000000 -0.69511425017762 -0.52428800000000 -0.14829104003789 
o 


SYSTEM REPRESENTATION IN THE z-DOMAIN 
a — 


Similar to the frequency response function H (e"), we can define the 
z-domain function, H(z), called the system function. However, unlike 
H (e^), H(z) exists for systems that may not be BIBO stable. 


m CDEFINITIONI The System Function 
The system function H(z) is given by 


H(z) S Z [hin] = Y, h(nz "; Ra- < [el < Rao (4.17) 


Using the convolution property (4.11) of the z-transform, the output 
transform Y(z) is given by 


Y(z) = H(z) X(z) : ROC, = ROC N ROC, (4.18) 
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provided ROC, overlaps with ROC);. Therefore a linear and time- 
invariant system can be represented in the z-domain by 


X(z) —[na]— vo = H(z) X(z) 


When LTI systems are described by a difference equation 


N M 
y(n) + D> axy(n — k) =$ bex(n — £) (4.19) 
k=1 


£=0 


the system function H(z) can easily be computed. Taking the z-transform 
of both sides, and using properties of the z-transform, 


N M 
Y(z)+ x ayz^ "Y (z) = X bz  X(z) 
£0 


k=1 
or 
M - 
AY A _ Bw) 
H(z) = XG)^ N il (4.20) 
l4 Y) age-* 
k=1 
E boz- M (aM eR) 
(0 z7N (zN +- +an) 
After factorization, we obtain 
N 
I] (2 - ze) 
H(z) = bp zN-M £1 — (4.21) 
TI (z — px) 
k=1 


where z/'s are the system zeros and p,’s are the system poles. Thus H(z) 
(and hence an LTI system) can also be represented in the z-domain using 
a pole-zero plot. This fact is useful in designing simple filters by proper 
placement of poles and zeros. 

To determine zeros and poles of a rational H(z), we can use the 
MATLAB function roots on both the numerator and the denominator 
polynomials. (Its inverse function poly determines polynomial coefficients 
from its roots as we discussed in the previous section.) It is also possible 
to use MATLAB to plot these roots for a visual display of a pole-zero plot. 
The function zplane(b,a) plots poles and zeros, given the numerator row 
vector b and the denominator row vector a. As before, the symbol “o” 
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represents a zero and the symbol “x” represents a pole. The plot includes 
the unit circle for reference. Similarly, zplane(z,p) plots the zeros in 
column vector z and the poles in column vector p. Note very carefully the 
form of the input arguments for the proper use of this function. 


If the ROC of H(z) includes a unit circle (z = eJ"), then we can evaluate 
H(z) on the unit circle, resulting in a frequency response function or 
transfer function H(e?"). Then from (4.21) 


[e - 2) 
He") = by PATM  — —— (4.22) 
II(e/^ — pr) 


1 


The factor (e^ — ze) can be interpreted as a vector in the complex z-plane 
from a zero zg to the unit circle at z = e", while the factor (e?^ — Pk) 
can be interpreted as a vector from a pole px to the unit circle at z = e". 


This is shown in Figure 4.6. Hence the magnitude response function 


le" — a|--- |e% - zu 


|H(e*)| = [bol le p| le — pul 


(4.23) 


can be interpreted as a product of the lengths of vectors from zeros to the 
unit circle divided by the lengths of vectors from poles to the unit circle 
and scaled by |bo|. Similarly, the phase response function 


M N 
LH (e?) =[0 or n) + (N — M)u] + Do L — zr) - 2 L(e* — pk) 
Y M 1 


constant linear 





nonlinear 


(4.24) 





FIGURE 4.6 Pole and zero vectors 
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can be interpreted as a sum of a constant factor, a linear-phase factor, 
and a nonlinear-phase factor (angles from the “zero vectors” minus the 
sum of angles from the “pole vectors”). 


In Chapter 3 we plotted magnitude and phase responses in MATLAB by 
directly implementing their functional forms. MATLAB also provides a 
function called freqz for this computation, which uses the interpretation 
given above. In its simplest form this function is invoked by 


[H,w] = freqz(b,a,N) 


which returns the N-point frequency vector w and the N-point complex fre- 
quency response vector H of the system, given its numerator and denomi- 
nator coefficients in vectors b and a. The frequency response is evaluated 
at N points equally spaced around the upper half of the unit circle. Note 
that the b and a vectors are the same vectors we use in the filter func- 
tion or derived from the difference equation representation (4.19). The 
second form 


[H,v] = freqz(b,a,N,'whole') 


uses N points around the whole unit circle for computation. In yet another 
form 


H * fregz(b,a,w) 


it returns the frequency response at frequencies designated in vector w, 
normally between 0 and 7. 


Given a causal system 


y(n) = 0.9y(n — 1) + z(n) 


a. Find H(z) and sketch its pole-zero plot. 
b. Plot |H(e/")| and 2H(e*“). 
c. Determine the impulse response h(n). 


The difference equation can be put in the form 
y(n) - 0.9y(n — 1) = x(n) 
a. From (4.21) 


"C DIS. 
1 — 0.9271? 


since the system is causal. There is one pole at 0.9 and one zero at the origin. 
We will use MATLAB to illustrate the use of the zplane function. 


H(z) = |z| > 0.9 
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>> b= [i, 0]; a = [1, -0.9]; 
»» zplane(b,a) 


Note that we specified b=[1,0] instead of b=1 because the zplane function 
assumes that scalars are zeros or poles. The resulting pole-zero plot is shown in 
Figure 4.7. 

b. Using (4.23) and (4.24), we can determine the magnitude and phase 
of H(e/"). Once again we will use MATLAB to illustrate the use of the freqz 
function. Using its first form, we will take 100 points along the upper half of 
the unit circle. 


>> [H,w] = freqz(b,a,100); 

>> magH = abs(H); phaH = angle(H); 

>> subplot (2,1,1) ;plot (w/pi,magH) ; grid 

>> xlabel(’frequency in pi units’); ylabel(’Magnitude’ ); 

>> title('Magnitude Response?) 

»» subplot(2,1,2);plot(w/pi ,phaH/pi);grid 

>> xlabel(’frequency in pi units’); ylabel(’Phase in pi units’); 
>> title(’Phase Response’) 


The response plots are shown in Figure 4.8. If you study these plots carefully, 


you will observe that the plots are computed between 0 < w < 0.997 and fall 
short at w = 7. This is due to the fact that in MATLAB the lower half of the 
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FIGURE 4.7  Pole-zero plot of Example 4.11a 
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FIGURE 4.8 Frequency response plots in Example 4.11 


0.8 


unit circle begins at w = 7. To overcome this problem, we will use the second 
form of the freqz function as follows. 


>> [H,w] = freqz(b,a,200, whole’); 
>> magH = abs(H(1:101)); phaH = angle(H(1:101)); 


Now the 101st element of the array H will correspond to w = T. A similar result 
can be obtained using the third form of the freqz function. 


>> w = [0:1:100]*pi/100; 
>> H = freqz(b,a,w); 
>> magH = abs(H); phaH = angle(H); 


In the future we will use any one of these forms, depending on our convenience. 
Also note that in the plots we divided the w and phaH arrays by pi so that 
the plot axes are in the units of 7 and easier to read. This practice is strongly 
recommended. l 

c. From the z-transform Table 4.1 


=, lel > 0.9] = (0.9)"u(n) ü 


E 1 
"E 1 
Rue f: —0977 


ee 
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Given that 


is a causal system, find 


z+1 
H(z) = 379924081 


a. its transfer function representation, 
b. its difference equation representation, and 
c. its impulse response representation. 





The poles of the system function are at z = 0.92 + 7/3. Hence the ROC of the 
above causal system is |z| > 0.9. Therefore the unit circle is in the ROC, and 


the discrete-time Fourier transform H (e^) exists. 
a. Substituting z = e/" in H(z), 
e" +1 e +1 


jw\ _ = rrr 
H(e*) = Sage F081 (07 —0967/5)(&« — 0.9e7) 


b. Using H(z) = Y(z)/X(z), 


Y(z) _ z+1 z;4 zirx£r? 
X(z) 22 —0.92+0.81 V 27 = 1-092-! + 0.8127? 


Cross multiplying, 

Y(z) - 0.92 Y(z) + 0.81277Y (z) = 21 X (z) + z ^ X(z) 
Now taking the inverse z-transform, 

y(n) — 0.9y(n — 1) + 0.81y(n — 2) =2(n—1)+ a(n — 2) 
or 

y(n) = 0.9y(n - 1) - 0.81y(n — 2) + z(n - 1) + a(n — 2) 


c. Using MATLAB, 


>> b = [0,1,1]; a= [1,-0.9,0.81]; 
>> [R,p,Cl- residuez(b,a) 


-0.6173 + 0.99791 
-0.6173 - 0.99794 


0.4500 - 0.7794i 
0.4500 * 0.7794i 


1.2346 
>> Mp = abs(p’) 
Mp = 
0.9000 0.9000 
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>> Ap = angle(p’)/pi 
Ap = 
-0.3333 0.3333 


we have 


—0.6173 + j0.9979 , —0.6173 — j0.9979 


H(z) = 1.234 ae ef aer 
(2) = 1.2346 + [19 giecin 5-1 * 1- [09] ein/3271 " 


|z| > 0.9 


Hence from Table 4.1 
h(n) = 1.23465(n) + [(—0.6173 + 50.9979) |0.9|" eg inn/3 
+ (0.6173 — j0.9979) [0.9" e/7"/]u(n) 
= 1.23466(n) + |0.9|" [1.2346 cos (7/3) + 1.9958 sin (1n/3)] u(n) 
= |0.9|" [1.2346 cos (7/3) + 1.9958 sin (xn/3)] u(n — 1) 
The last step results from the fact that h(0) — 0. a 


In this and the previous two chapters we developed several system repre- 
sentations. Figure 4.9 depicts the relationships between these representa- 
tions in a graphical form. 


For LTI systems the BIBO stability is equivalent to Y lh(k)| < oo. 
From the existence of the discrete-time Fourier transform this stability 
implies that H (e/^) exists, which further implies that the unit circle |z| = 
1 must be in the ROC of H(z). This result is called the z-domain stability 







Express H(z) in z^! 
cross multiply and 
take inverse 


Take inverse 
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FIGURE 4.9 System representations in pictorial form 
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theorem; therefore the dashed paths in Figure 4.9 exist only if the system 
is stable. 


z-Domain LTI Stability 
An LTI system is stable if and only if the unit circle is in the ROC 
of H(z). 


For LTI causality we require that h(n) = 0, for n < 0 (i.e., a right- 
sided sequence). This implies that the ROC of H(z) must be outside of 
some circle of radius R4. This is not a sufficient condition since any 
right-sided sequence has a similar ROC. However, when the system is 
stable, then its causality is easy to check. 


z-Domain Causal LTI Stability 
A causal LTI system is stable if and only if the system function H(z) 
has all its poles inside the unit circle. 


A causal LTI system is described by the following difference equation: 
y(n) = 0.81y(n — 2) + x(n) — a(n — 2) 
Determine 


a. the system function H(z), 

b. the unit impulse response h(n), 

c. the unit step response v(n), that is, the response to the unit step u(n), 
and 

d. the frequency response function H (e^), and plot its magnitude and 
phase over 0 <w € 7. 


Solution Since the system is causal, the ROC will be outside of a circle with radius equal 
to the largest pole magnitude. 
a. Taking the z-transform of both sides of the difference equation and then 
solving for Y(z)/X(z) or using (4.20), we obtain 
1-27? 1-27? 
= = ooo 0. 
H(z) = i—gsiz3 ^ (140923)0 -092-1) acd 
b. Using MATLAB for the partial fraction expansion, 
>> b = (1,0,-1]; a = [1,0,-0.81); 
>>[R,p,c] = residuez(b,a); 
R= 
-0.1173 
-0.1173 
P 
-0.9000 
IT 
System Representation in the 2-Domain 103 








0.9000 
C = 
1.2346 
we have 
1 1 
H(z) = 1.2346 — 0.11737 T 09771 =s 0.11737 2z lzl > 09 


or from Table 4.1 





h(n) = 1.23466(n) — 0.1173 {1 + (—1)"} (0.9) u(n) 








c. From Table 4.1 Z [u(n)] = , |z| > 1. Hence 


1 
1-271 


V() = H(2)UG) = lees [ta]. >on 
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FIGURE 4.10 Frequency response plots for Example 4.13 
Finally, 


v(n) = [1.0556 (0.9)" — 0.0556 (—0.9)"] u(n) 


Note that in the calculation of V(z) there is a pole-zero cancellation at z — 1. SOLUTIONS OF THE DIFFERENCE EQUATIONS 
This has two implications. First, the ROC of V(z) is still {|z| > 0.9} and L———————— —»——— 


not {|z| > 0.9 |z| > 1 = |z| > 1}. Second, the step response v(n) contains no 
steady-state term u(n). 


d. Substituting z = e in H(z), In Chapter 2 we mentioned two forms for the solution of linear constant 


coefficient difference equations. One form involved finding the particu- 

1 — e7% lar and the homogeneous solutions, while the other form involved finding 
1- 0.81e-32« the zero-input (initial condition) and the zero-state responses. Using z- 
transforms, we now provide a method for obtaining these forms. In ad- 
dition, we will also discuss the transient and the steady-state responses. 


H(e^) = 


We will use MATLAB to compute and plot responses. 


>> w = [0:4:500] *pi/500; In digital signal processing difference equations generally evolve in the 
>> H = freqz(b,a,w); positive n direction. Therefore our time frame for these solutions will be 
>> magH = abs(H); phaH = angle(H); n > 0. For this purpose we define a version of the bilateral z-transform 
»» subplot(2,1,1); plot(w/pi,magH); grid called the one-sided z-transform. 


>> xlabel(’frequency in pi units’); ylabel (’Magnitude’) 

>> title('Magnitude Response’) 

>> subplot(2,1,2); plot(w/pi,phaH/pi); grid 

>> xlabel(frequency in pi units’); ylabel(’Phase in pi units’) 
>> title(’Phase Response’) 


m CDEFINITION4 The One-sided z Transform 
The one-sided z-transform of a sequence x(n) is given by 


oo 
Z+ [e(n] Ê Ziíz(m)um) £ X+ [2] 2 35200277 — (425) 
The frequency response plots are shown in Figure 4.10. o n=0 


Ne 
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Then the sample shifting property is given by 


Z* [e(n - )] = Z [e(n — ku(n)] 


= Yan —k)z"= Y z(m)z- mtk) 
n=0 m--k 

= 5 z(m)z- 9 t x se] zh 
m=—k m=0 


or 
Zt [2(n—-k)] = a(-1)z'-* 4z(-2)27* 4-- .+a(—k) +27" X+ (z) (426) 


This result can now be used to solve difference equations with nonzero 
initial conditions or with changing inputs. We want to solve the difference 


equation 
N M 
1 +d oary(n -k)- Y b z(n— m), n 20 
k=1 m=0 
subject to these initial conditions: 
{y(i), i= -1,...,-N} and {x(i),i= -1,...,-M}. 


We now demonstrate this solution using an example. 


ü EXAMPLE 4.14 Solve 
1 
in) - Sy(n—1)+ gun 2) = a(n), n 2.0 


where 


a(n) = G) u(n) 


subject to y(—1) = 4 and y(—2) = 10. 
Solution Taking the one-sided z-transform of both sides of the difference equation, we 
obtain 
1 
- 1 - -2y4(,)] = 
Y+- +2 y+ (ay) +5 [-2) wn +2 7¥ ol- pos 


Substituting the initial conditions and rearranging, 


3 = 1.2]. 1 urit 
v*oh-35: 3 j= te 2z ) 
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or 


1 
1-izi 1-2z 
Y*(z) = —À4—À —— + —À3——4—5 421 
(2) 1—Sz-1 442-2 © 1- B21 + 327? (4.27) 
Finally, 
2— 2z! p 1z? 
Y+(z)= t e ILN 
(1-4271) (1-27) (1- 1271) 
Using the partial fraction expansion, we obtain 
+ 1 3 3 
Y = —— + - + + — ; 
(2) 1-izi T 1-27! * 1-427} (4.28) 
After inverse transformation the solution is 
1\"_ 2~=1/1\" 
y(n) = IG) tatg (4) | un) O (4.29) 


Forms of the Solutions The above solution is the complete response 
of the difference equation. It can be expressed in several forms. 


e Homogeneous and particular parts: 


Om Oks 


homogeneous part particular part 


The homogeneous part is due to the system poles and the particular part 
is due to the input poles. 
e Transient and steady-state responses: 


1 /1\" 1\" 2 
y(n) -[; (4) + (5) | u(n) + 39 
transient response steady-state response 


The transient response is due to poles that are inside the unit circle, while 
the steady-state response is due to poles that are on the unit circle. Note 
that when the poles are outside the unit circle, the response is termed an 
unbounded response. 

e Zero-input (or initial condition) and zero-state responses: 
In equation (4.27) Y * (z) has two parts. The first part can be interpreted 
as 


Yzs(z) = H(z)X(z) 
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while the second part as 


Yzi(z) = H(z)Xic(2) 


where X;c(z) can be thought of as an equivalent initial-condition input 
that generates the same output Yz; as generated by the initial conditions. 
In this example zrc(n) is 


zic(n) = i -2) 


Now taking the inverse z-transform of each part of (4.27), we write the 
complete response as 


TOEO e + 6) d 


zero-state response zero-input response 


From this example it is clear that each part of the complete solution is, in 
general, a different, function and emphasizes a different aspect of system 
analysis. 


MATLAB In Chapter 2 we used the filter function to solve the difference equation, 
IMPLEMEN- given its coefficients and an input. This function can also be used to find 
TATION the complete response when initial conditions are given. In this form the 


filter function is invoked by 
yr filter(b,a,x,xic) 


where xic is an equivalent initial-condition input array. To find the com- 
plete response in Example 4.14, we will use 


>> n= [0:7]; x = (1/2).7n; xic = l1, -2]; 
>> format long 
>> yi = filter(b,a,x,xic) 
yi = 
Columns 1 through 4 
2.00000000000000 1.25000000000000 0.93750000000000 0.79687500000000 
Columns 5 through 8 
0.73046875000000 0.69824218750000 0.68237304687500 0.67449951171875 
>> y2 = (1/3)*(1/4) .^n* (1/2) .^n*(2/3)*ones(1,8) 4 Matlab Check 
y27 l 
Columns 1 through 4 
2.00000000000000 1.25000000000000 0.93750000000000 0.79687500000000 
Columns 5 through 8 
0.73046875000000 0.69824218750000 0.68237304687500 0.67449951171875 
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which agrees with the response given in (4.29). In Example 4.14 we com- 
puted zc (n) analytically. However, in practice, and especially for large- 
order difference equations, it is tedious to determine rjc (n) analytically. 
MATLAB provides a function called filtic, which is available only in the 
Signal Processing toolbox (version 2.0b or later). It is invoked by 


xic = filtic(b,a,Y,X) 


in which b and a are the filter coefficient arrays and Y and X are the initial- 
condition arrays from the initial conditions on y(n) and x(n), respectively, 
in the form 


Y = (y(—1), y(-2),---, w(-N)] 
X= {x(-1), z(-2),..., z(-M)] 


Ifz(n)=0, n < -—1 then X need not be specified in the £iltic function. 
In Example 4.14 we could have used 


>> Y = [4, 10]; 
>> xic = filtic(b,a,Y) 
Y= 

1 -2 


to determine zc (n). 


Solve the difference equation 
y(n) = (a(n) +z(n— 1) + z(n - 2)] + 0.95y(n — 1) -09025y(n-2), n20 
where x(n) = cos(7n/3)u(n) and 

y(-1) = -2, y(-2) = -3; z(-1) = 1, 2(-2) =1 


First determine the solution analytically and then by using MATLAB. 


Taking a one-sided z-transform of the difference equation 


Yt(z)= 5 [X+ (2) +2(-1) + z7 X+ (2) +a(-2) + z7*e(—1) 2 ?X* (2)] 
+0.95 fy(—1) +2 7 Y* (z)] — 0.9025 [y(-2) + z^ly(-1) +z7°Y+(2)] 
and substituting the initial conditions, we obtain 
lrizcdz 
1— 0.952-1 + 0.90252? 


2 1.4742 + 2.138327} 


1- 0.952-! + 0.902527? 


zt -1 
Clearly, zic(n) = (1.4742, 2.1383]. Now substituting X*(z) = er 
and simplifying, we will obtain Y * (z) as a rational function. This simplification 
and further partial fraction expansion can be done using MATLAB as shown 
below. 


Y*(z)= Xt(z)+ 


SS a eS T 
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>> b = [1,1,1]/3; a = [1,-0.95,0.9025]; 
>> Y = (-2,-3]; X = (1,1); 
>> xic=filtic(b,a,Y,X) 
xic = 

1.4742 2.1383 
>> bxplus = [1,-0.5]; axplus = {1,-1,1]; % X(z) transform coeff. 
>> ayplus = conv(a,axplus) % Denominator of Yplus(z) 
ayplus = 

1.0000 -1.9500 2.8525 -1.8525 0.9025 
>> byplus = conv(b,bxplus)+conv(xic,axplus) % Numerator of Yplus(z) 
byplus = 

1.8075 0.8308 -0.4975 1.9717 

>> [R,p,C] = residuez(byplus, ayplus) 
R= 

0.0584 + 3.9468i 0.0584 - 3.94681 0.8453 + 2.0311i 0.8453 - 2.03111 





>> n = (0:71; x = cos(pi*n/3); 
> y= filter (b,a,x,xic) 
y= 
Columns 1 through 4 
1.80750000000000 4.35545833333333 2. 83975000000000 -1. 56637197916667 
Columns 5 through 8 
-4.71759442187500 -3.40139732291667 1. 35963484230469 5.02808085078841 
% Matlab Verification 
>> A-real(2*R(1)); Beimag(2*R(1)); Cereal(2*R(3)); D-imag(2*R(4)); 
>> y=A*cos (pi*n/3)*B*sin(pi*n/3)*((0.95). ^n) .*(C*cos (pi*n/3) 4D*sin(pi*n/3)) 
y= 
Columns 1 through 4 
1.80750000000048 4.35545833333359 2. 83974999999978 -1.56637197916714 
Columns 5 through 8 
-4.71759442187528 -3.40139732291648 1. 35963484230515 5.02808085078871 


= n 
0.5000 - 0.8660i 0.5000 + 0.8660i 0.4750 + 0.8227i 0.4750 - 0.8227i 
c= PROBLEMS 
ü 

>> Mp = abs(p), Ap = angle(p)/pi % Polar form P441 Determine the z-transform of the following sequences using definition (4.1). Indicate the 
Mp = region of convergence for each sequence and verify the z-transform expression using 

1.0000 1.0000 0.9500 0.9500 MATLAB. 
Ap = 


-0.3333 0.3333 0.3333 -0.3333 


Hence 


1.8076 + 0.830827! — 0.497527? + 1.97172? 


Yt) = .— A 
(2) = 17 1857-14 2.85252? — 1.85252-9 + 0.902574 


a. z(n) = {3,2,1, -2, -3] 
T 

b. x(n) = (0.8)" u (n — 2) 

c. z(n) = ($) v - 0) 


d. z(n) = 2-ll 4. qa)" 
e. x(n) — (n 41) (3)" u(n) 


_ 0.0584 + 73.9468 , 0.0584 — 43.9468 P4.2 Determine the z-transform of the following sequences using the z-transform table and the 
ope 1 — ei/3z-1 z-transform properties. Express X (z) as a rational function in z^!. Verify your results 
0.8453 + 72.0311 0.8453 — 2.0311 using MATLAB. Indicate the region of convergence in each case and provide a pole-zero plot. 
1— 0.95e/*/3z7-1 " 1— 0.95e-i7/32-1 a. x(n) = 26(n — 2) + 3u (n - 3) 
Now from Table 4.1 b. x(n) = (3)" u(n - 2) + (09^ * u (n) 
j . = ; zn n "T" 
y(n) = (0.0584 + 3.9468) e 77"? + (0.0584 — j3.9468) e/7^/* c. a(n) = nsin (4) u (n) + (0.9)" u(n — 2) 
; n jan/3 j d. x(n) = (1)" cos (3e — 45°) u(n — 1) 
+ (0.8453 + j2.031) (0.95)" e? + (0.8453 — j2.031) (0.95) LUE is 
e. z(n) = (n - 3) (1) cos (£ (n  1)) u(n) 
= 0.1169 cos (1n/3) + 7.8937 sin (1n/3) 
P4.3 The z-transform of x(n) is X (z) = (1 + 227), |z| #0. Find the z-transforms of the 


+ (0.95)" [1.6906 cos (1/3) — 4.0623 sin (n/3)), n20 


The first two terms of y(n) correspond to the steady-state response, as well as 
to the particular response, while the last two terms are the transient response 
(and homogeneous response) terms. 

To solve this example using MATLAB, we will need the filtic function, 
which we have already used to determine the z;c(n) sequence. The solution 
will be a numerical one. Let us determine the first 8 samples of y(n). 


following sequences, and indicate their regions of convergence. 
a. zy (n) - z(3- n) t z(n - 3) 

b. z2(n) = (1 n n?) z (n) 

c. za (n) = (3) z(n -2) 

d. z4 (n) = z(n 2) * z(n- 2) 

e. xs (n) = cos (1n/2) z* (n) 


A e 
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P4.4 


P4.5 


P4.6 


P4.7 


P4.8 
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Repeat Problem 4.3 if 


1427} 


X (2) = ai 
O= Ipi iea 


1 
l5 


The inverse z-transform of X (z) is z (n) = ay v (n). Using the z-transform properties, 
determine the sequences in each of the following cases. 

a. Xi(z) = £z: X (2) 

b. Xo(z) = 2X (7) 

c. X3(z) = 2X (3z) + 3X (2/3) 

d. Xa(z) = X (2) X (277) 


e. Xs(z) = 2? ex) 





If sequences zi (n), z2 (n), and zs (n) are related by z3 (n) = z1 (n) * z2 (n), then 


oo oo oo 
3 23(n) = ( Ya e) ( »»E- e) 
n--oo n=—00 n--—oo 

a. Prove the above result by substituting the definition of convolution in the left-hand side. 
b. Prove the above result using the convolution property. 

c. Verify the above result using MATLAB by choosing any two sequences x1 (n) and z2 (n). 
Determine the results of the following polynomial operations using MATLAB. 

a. Xi(z) = (1-227! +327? - 4279) (4-327! — 227? + 27?) 

b. X2(z) = (2 —22 84227 +277) (2-27) 


c. Xa(z) = (1 27 + xci 

d. X4(z) = X1 (z) X2 (z) + Xa (z) 

e. Xs(z) = (27! — 8278 2275 6277 — 279) (z+ 32? + 228 + 424) 

The deconv function is useful in dividing two causal sequences. Write a MATLAB function 


deconv.m to divide two noncausal sequences (similar to the conv function). The format of 
this function should be 


function [p,np,r,nr] = deconv m(b,nb,a,na) 
% Modified deconvolution routine for noncausal sequences 
% function [p,np,r,nr] = deconv m(b,nb,a,na) 


* p polynomial part of support npi <= n <= np2 

% np = (npi, np2] 

X xv = remainder part of support nri <= n <= nr2 

[nri, nr2] 

* b = numerator polynomial of support nbi <= n <= nb2 
% nb = [nbi, nb2] 

% a = denominator polynomial of support nai <= n <= na2 
* na = [nai, na2] 


E 
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Check your function on the following operation: 


z2 +z+l+z 4z +? A 4,927432? 
zíz-142:7-232:7)4.25 5. 
zt2-421 (2 oes à )tllz rr 





Determine the following inverse z-transforms using the partial fraction expansion method. 


a. Xi(z) = (1—27! — 477? + 427°) /(1— Bet + Be? - 427), The sequence is 
right-sided. 


b. X2(z) = (12 2! - 427 t473)/0-2z74$27?- 1272). The sequence is 
absolutely summable. 


c. Xa (z) = (22 — 32? 42  1)/ (2° — 42? + z — 0.16). The sequence is left-sided. 
d. Xa (z) = z/ (23 + 22? + 1.25z + 0.25), |z| > 1. 
e. Xs(z) = z/ (2 - 0.25)”, |z| < 0.5. 





P4.10 Suppose X (z) is given as follows: 
24327 
Xi =por P509 
a. Determine z (n) in a form that contains no complex numbers. 
b. Using MATLAB, find the first 20 samples of z (n) and compare them with your answer in 
the above part. 

P4.11 For the linear and time-invariant systems described by the impulse responses below, 
determine (i) the system function representation, (ii) the difference equation representation, 
(iii) the pole-zero plot, and (iv) the output y (n) if the input is z (n) — (4) u(n). 

a. h(n) 22 (1)" u(n) 

b. h(n) 2n (3) u(n) + (-1) u(n) 

c. h(n) = 3(0.9)" cos (1n/4 + 7/3) u (n + 1) 
d. h(n) =n [u (n) — u (n — 10)] 

e. h(n) = [2 —sin(an)] u (n) 

P4.12 For the linear and time-invariant systems described by the system functions below, 
determine (i) the impulse response representation, (ii) the difference equation 
representation, (iii) the pole-zero plot, and (iv) the output y (n) if the input is 
a(n) = 3cos (rn/3) u (n). 

a. H(z) = (z + 1)/ (z — 0.5), causal system. 
b. H(z) - (1-2! + z7?) / (1+ 0.577} = 0.2527?) , stable system. 
c. H(z) = (2-1)/(- 3)?, anticausal system. 
z 1-052! 
d. H(z) - 25938 ise stable system. 
e. H(z 2 (1+2 + 272), stable system. 

P4.13 For the linear, causal, and time-invariant systems described by the difference equations 
below, determine (i) the impulse response representation, (ii) the system function 
representation, (iii) the pole-zero plot, and (iv) the output y (n) if the input is 
z (n) = 2(0.9)" u (n). 
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P4.14 


P4.15 


P4.16 


P4.17 


P4.18 
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peer 


p 


. y(n) = [z (n) + 2z (n — 1) + z (n - 3)] /4 

. y(n) = z (n) + 0.5z (n — 1) — 0.5y (n — 1) + 0.25y (n -2) 

y (n) = 2x (n) + 0.9y (n — 1) 

. y (n) = —0.45z (n) — 0.4z (n — 1) + æ (n — 2) + 0.4 (n — 1) + 0.45y (n — 2) 

y (n) = E$ o (0.8) z (n — m) — Er (09) y (n — 0) 

The output sequence y (n) in Problem 4.13 is the total response. For each of the systems 
given in that problem, separate y (n) into (i) the homogeneous part, (ii) the particular part, 
(iii) the transient response, and (iv) the steady-state response. 


ono 7 


A stable system has the following pole-zero locations: 


DERE CE NEUES 
A=); 2=-j, P= 2 Jy P2 = 3 J3 


Tt is also known that the frequency response function H (e^) evaluated at w = 0 is equal to 
0.8; that is, 


H (e?) =08 


a. Determine the system function H (z) and indicate its region of convergence. 


b. Determine the difference equation representation. 


c. Determine the steady-state response yss (n) if the input is z (n) = a sin (=) u(n). 


d. Determine the transient response y:r (n) if the input is z (n) = 5 sin (=) u(n). 
A digital filter is described by the difference equation 


y(n) — z (n) +2 (n — 1) + 0.9y (n — 1) - 0.81y (n - 2) 


a. Using the freqz function, plot the magnitude and phase of the frequency response of the 
above filter. Note the magnitude and phase at w = 7/3 and at w = 7. 


b. Generate 200 samples of the signal z (n) = sin (1n/3) + 5cos (mn) and process through 
the filter. Compare the steady-state portion of the output to z (n). How are the amplitudes 
and phases of two sinusoids affected by the filter? 


Solve the following difference equation for y (n) using the one-sided z-transform approach. 
y(n) =0.5y (n — 1) +0.25y(n-2)+2(n), n20; y(-1-1 y(-2) =2 
z (n) = (0.8)" u (n) 


Generate the first 20 samples of y (n) using MATLAB and compare them with your answer. 
Solve the difference equation for y(n), n20 


y (n) — 0.4y (n — 1) — 0.45y (n — 2) = 0.452 (n) + 0.42 (n — 1)-z(n-2) 
driven by the input x(n) = 2+ (y u (n) and subject to 
y(-1) 20, y(—2) 2 3; z(-1) == 2(-2) = 2 


Decompose the solution y (n) into (i) transient response, (ii) steady-state response, (iii) zero 
input response, and (iv) zero-state response. 
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P4.19 A causal, linear, and time-invariant system is given by the following difference equation: 


P4.20 


Problems 


y(n) = y(n - 1) + y(n — 2) + z(n - 1) 
a. Find the system function H(z) for this system. 
b. Plot the poles and zeros of H(z) and indicate the region of convergence (ROC). 
c. Find the unit sample response h(n) of this system. 


d. Is this system stable? If the answer is yes, justify it. If the answer is no, find a stable 
unit sample response that satisfies the difference equation. 


Determine the zero-state response of the system 
y(n) - iy(n-1)9z(n)t3z(n-1), n20; y(-1)=2 
to the input 
z (n) = €7"/*u (n) 


What is the steady-state response of the system? 
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THE DISCRETE 
FOURIER 
TRANSFORM 


In Chapters 3 and 4 we studied transform-domain representations 
of discrete signals. The discrete-time Fourier transform provided the 
frequency-domain (w) representation for absolutely summable sequences. 
The z-transform provided a generalized frequency-domain (z) represen- 
tation for arbitrary sequences. These transforms have two features in 
common. First, the transforms are defined for infinite-length sequences. 
Second, and the most important, they are functions of continuous vari- 
ables (w or z). From the numerical computation viewpoint (or from 
MATLAB’s viewpoint), these two features are troublesome because one 
has to evaluate infinite sums at uncountably infinite frequencies. To use 
MATLAB, we have to truncate sequences and then evaluate the expressions 
at finitely many points. This is what we did in many examples in the two 
previous chapters. The evaluations were obviously approximations to the 
exact calculations. In other words, the discrete-time Fourier transform 
and the z-transform are not numerically computable transforms. 
Therefore we turn our attention to a numerically computable trans- 
form. It is obtained by sampling the discrete-time Fourier transform in the 
frequency domain (or the z-transform on the unit circle). We develop this 
transform by first analyzing periodic sequences. From Fourier analysis we 
know that a periodic function (or sequence) can always be represented by 
a linear combination of harmonically related complex exponentials (which 
is a form of sampling). This gives us the Discrete Fourier Series (or DFS) 
representation. Since the sampling is in the frequency domain, we study 
the effects of sampling in the time domain and the issue of reconstruction 
in the z-domain. We then extend the DFS to finite-duration sequences, 
which leads to a new transform, called the Discrete Fourier Transform 
(or DFT). The DFT avoids the two problems mentioned above and is 





a numerically computable transform that is suitable for computer imple- 
mentation. We study its properties and its use in system analysis in detail. 
The numerical computation of the DFT for long sequences is prohibitively 
time consuming. Therefore several algorithms have been developed to effi- 
ciently compute the DFT. These are collectively called fast Fourier trans- 
form (or FFT) algorithms. We will study two such algorithms in detail. 


THE DISCRETE FOURIER SERIES 
LL —————— —— 


In Chapter 2 we defined the periodic sequence by ž(n), satisfying the 
condition 


&(n)- z(n--kN),  Vmn,k (5.1) 


where N is the fundamental period of the sequence. From Fourier analysis 
we know that the periodic functions can be synthesized as à linear com- 
bination of complex exponentials whose frequencies are multiples (or har- 
monics) of the fundamental frequency (which in our case is 21/ N). From 
the frequency-domain periodicity of the discrete-time Fourier transform, 
we conclude that there are a finite number of harmonics; the frequencies 
are (25k, k=0,1,...,.N—- 1}. Therefore a periodic sequence &(n) can 
be expressed as 


N-1 
#(n) = x PÄ, n=0,41,..., (5.2) 
k=0 


where (X(k), k=0,+1,...,} are called the discrete Fourier series co- 
efficients, which are given by 


N-1 
X(k) = Y, (nje 75", k= 0,41,..., (5.3) 


n=0 


Note that X(k) is itself a (complex-valued) periodic sequence with fun- 
damental period equal to N, that is, 


X(k+N) = X(K) (5.4) 


The pair of equations (5.3) and (5.2) taken together is called the discrete 


Fourier series representation of periodic sequences. Using Wn 2 738 to 


aan a ———————— " — ——À—— oas ek. o oM tur e ee Se 
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n EXAMPLE 5.1 


Solution 


MATLAB 
IMPLEMEN- 
TATION 
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denote the complex exponential term, we express (5.3) and (5.2) as 


z N-1 
X(k) Ê DFS(z(n) = Y, s(nWy* : Analysis or a 
n=0 DFS equation 
A 5 1 Nal- k 
£(n) = IDFS [x (x)| =F X(k)Wy”* : Synthesis or an inverse 
k=0 


B DFS equation 
(5.5) 


Find DFS representation of the periodic sequence given below: 


&(n) = (...,0,1,2,3,0,1,2,3,0,1,2,3,...) 
T 


The fundamental period of the above sequence is N = 4. Hence W4 = e = 
—j. Now 


3 
X(k) = 3 žm wē", k-0,21,22,... 
n=0 


Hence 


3 3 
X(0) = Yo a(nywe* = 3586) = (0) + (1) + 2(2) + 23) = 6 
0 


0 


Similarly, 
3 3 
XQ) = Y amw =J 730973 = (-2 + 23) 
o 0 


3 3 
X) =X inw? =J i 22 
o 0 


3 3 
X(3) =D anw? = Y EOD” = (72 -23) o 
0 


0 


A careful look at (5.5) reveals that the DFS is a numerically computable 
representation. It can be implemented in many ways. To compute each 
sample X(k), we can implement the summation as a for...end loop. 
To compute all DFS coefficients would require another for...end loop. 
This will result in a nested two for...end loop implementation. This 
is clearly inefficient in MATLAB. An efficient implementation in MATLAB 
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would be to use a matrix-vector multiplication for each of the relations 
in (5.5). We have used this approach earlier in implementing a numerical 
approximation to the discrete-time Fourier transform. Let ž and X denote 
column vectors corresponding to the primary periods of sequences z(n) 
and X(k), respectively. Then (5.5) is given by 


X = Wy 
Sed erus (5.6) 
x= NWNX 
where the matrix Wy is given by 
n —2 
1 1 e 1 
N- 
aaa e 
W= [wh — E : : es : (5.7) 
N-1 N-1)? 
1 Wid... Win 


The matrix Wy is a square matrix and is called a DFS matriz. The 
following MATLAB function dfs implements the above procedure. 


function [Xk] = dfs(xn,N) 
% Computes Discrete Fourier Series Coefficients 


% [Xk] = dfs(xn,N) 
% Xk = DFS coeff. array over 0 <= k <= N-1 


% xn = One period of periodic signal over 0 <= n <= N-1 

% N = Fundamental period of xn 

% 

n = [0:1:N-1]; % row vector for n 

k = [0:1:N-1]; X row vecor for k 

WN = exp(-j*2*pi/N); % Wn factor 

nk = n'*k; % creates a N by N matrix of nk values 
WNnk = WN .^ nk; % DFS matrix 

Xk = xn * WNnk; % xow vector for DFS coefficients 


The DFS in Example 5.1 can be computed using MATLAB as 


>> xn = [0,1,2,3]; N = 4; 
>> Xk = dfs(xn,N) 


6.0000 -2.0000 + 2.0000i -2.0000 - 0.0000i -2.0000 - 2.00001 


a 
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The following idfs function implements the synthesis equation. 


function [xn] = idfs(Xk,N) 

% Computes Inverse Discrete Fourier Series 

% (xn) = idfs(Xk,N) 

% xn = One period of periodic signal over 0 <= n <= N-1 
% Xk = DFS coeff. array over 0 <= k <= N-1 

% N = Fundamental period of Xk 


* 

n = (0:1:N-1]; % row vector for n 

k = [0:1:N-1]; * row vecor for X 

WN = exp(-j*2*pi/N); % Wn factor 

nk = n'*k; € creates a N by N matrix of nk values 
WNnk = WN .^ (-nk); % IDFS matrix 

xn = (Xk * WNnk)/N; % row vector for IDFS values 


Caution: The above functions are efficient approaches of implementing 
(5.5) in MATLAB. They are not computationally efficient, especially for 
large N. We will deal with this problem later in this chapter. 


a EXAMPLE 5.2 A periodic “square wave" sequence is given by 


- o mN <n<mN+L-1 
a(n) = 


I = 0, +1,+2,... 
0, mN4E<as(m+yN-1) ^ 
where N is the fundamental period and L/N is the duty cycle. 


a. Determine an expression for |X (k)| in terms of L and N. 

b. Plot the magnitude |X(k)| for L = 5, N = 20; L=5,N=40;2=5, 
N = 60; and L=7, N = 60. 

c. Comment on the results. 


Solution A plot of this sequence for L — 5 and N = 20 is shown in Figure 5.1. 


Three periods of xtilde(n) 






05 
-20 -10 0 10 20 30 


FIGURE 5.1 Periodic square wave sequence 
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a. By applying the analysis equation (5.3), 


. N-1 L-1 L-1 
X(k) = Y se? 8 E ye = Y (e) 
n=0 n=0 , n-0 
L, k 20, EN, X2N,... 


= 4 1 e”i2?TLk/N 
I e REN otherwise 

The last step follows from the sum of the geometric terms formula (2.5) in 

Chapter 2. The last expression can be simplified to 


1- e752 Lk/N eg jr Lk/N gi" Lk/N g jT DAN 
dl-eJPRIN 7 e ink/N  gjmk]N — e-jnk/N 
= eirt- iun Sin (rkL/N) 
sin (rk/N) 
or the magnitude of X(k) is given by 
L, k =0,+N,+2N,... 
«| = 4 |sin (skL/N) 
“sin (sk/N) , Otherwise 





b. MATLAB script for L — 5 and N — 20 is given below. 


>> L = 5; N = 20; k = [-N/2:N/2]; % Sq wave parameters 
>> xn = [ones(1,L), zeros(1,N-L)]; % Sq wave x(n) 

>> Xk = dfs(xn,N); % DFS 

>> magXk = abs([Xk(N/2*1:N) Xk(1:N/2+1)]); % DFS magnitude 

>> subplot(2,2,1); stem(k,magXk) ; axis([-N/2,N/2,-0.5,5.5)) 

>> xlabel(’k’); ylabel(’Xtilde(k) ’) 

>> title(’DFS of SQ. wave: L=5, N-20?) 


The plots for the above and all other cases are shown in Figure 5.2. Note that 
since X(k) is periodic, the plots are shown from —N/2 to N/2. 

c. Several interesting observations can be made from plots in Figure 5.2. 
The envelopes of the DFS coefficients of square waves look like “sinc” functions. 
The amplitude at k = 0 is equal to L, while the zeros of the functions are at 
multiples of N/L, which is the reciprocal of the duty cycle. We will study these 


functions later in this chapter. D 
RELATION Let x(n) be a finite-duration sequence of duration N such that 
TO THE z- 
TRANSFORM i Nonzero, 0<n<N-1 
0, elsewhere (5.8) 


wuh ee ee a M EFE 
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DFS of SQ. wave: L=5, N=20 DFS of SQ. wave: L-5, N-40 
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DFS of SQ. wave: L=5, N=60 
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FIGURE 5.2 The DFS plots of a periodic square wave for various L and N. 


Then we can find its z-transform: 
N-1 


X(z) = zz" (5.9) 


n=0 


Now we construct a periodic sequence Z(n) by periodically repeating a(n) 
with period N, that is, 


&(n) O<n<N-1 
= 5.10 
zin) { 0, elsewhere (5-10) 
The DFS of ž(n) is given by 
- N-1 id N-1 mm 
X(k) = Y, ane FF" = Y^ a(n) [eit] (5.11) 
n=0 n=0 


Comparing it with (5.9), we have 
X(k) EF X(2), ap. (5.12) 


which means that the DFS X(k) represents N evenly spaced samples of 
the z-transform X(z) around the unit circle. 


a ae a UE RUDI TRATUR Eo 
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RELATION TO 
THE DTFT 


a EXAMPLE 5.3 


Since z(n) in (5.8) is of finite duration of length N, it is also absolutely 
summable. Hence its DTFT exists and is given by 


N-1 N-1 
X(e) = V s(n)? = ^ a(nje (5.13) 
n=0 n=0 


Comparing (5.13) with (5.11), we have 


X(k) = X(e*)| as, (5.14) 
Let 
22 2 
Wy = N and Uk £ =k = kwi 


then the DFS X (k) = X(ei*) = X (e^), which means that the DFS is 
obtained by evenly sampling the DTFT at wı = 27 intervals. From (5.12) 
and (5.14) we observe that the DFS representation gives us a sampling 
mechanism in the frequency domain which, in principle, is similar to sam- 
pling in the time domain. The interval w; = p is the sampling interval 
in the frequency domain. It is also called the frequency resolution because 
it tells us how close are the frequency samples (or measurements). 


Let x(n) = (0,1,2,3]. 
T 
a. Compute its discrete-time Fourier transform X (e^). 


b. Sample X(e/*) at kur = 2Rk, k = 0,1,2,3 and show that it is equal 
to X(k) in Example 5.1. 


Solution The sequence z(n) is not periodic but is of finite duration. 
a. The discrete-time Fourier transform is given by 
oo 
X(e")- Z z(n)e Fe" =e 4+ 26732» + 3e 79» 
n= 
b. Sampling at kwi = 27k, k= 0,1,2,3, we obtain 
X(e) =14243=6= X(0) 
X(t) = e7}?"/4 4 9e7347/4 4 gu7390/A -24+ 2j = X(1) 
X(t) = 7147/4 4 9g 587/44 ag 28/4 _ 9 = Š (2) 
X (814) = e7674 4 gg i2n/A 4 3e7i!87/4 _ 2 — 2j = X(3) 
as expected. o 
NN nn 
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SAMPLING AND RECONSTRUCTION IN THE z-DOMAIN 
LL ———————3——— 





Let x(n) be an arbitrary absolutely summable sequence, which may be of 
infinite duration. Its z-transform is given by 


oo 


X(z)- D z(m)z 


m--oo 
and we assume that the ROC of X (z) includes the unit circle. We sample 


X(z) on the unit circle at equispaced points separated in angle by w; = 
2n/N and call it a DFS sequence, 


ŠK) Ê Xl sae = 0,41, +2,-.- (5.15) 
= Z z(m)e 2 ^m — > a(m)wk 


which is periodic with period N. Finally, we compute the IDFS of X(k), 
#(n) = IDFS[X(k)] 


which is also periodic with period N. Clearly, there must be a relationship 
between the arbitrary x(n) and the periodic z(n). This is an important 
issue. In order to compute the inverse DTFT or the inverse z-transform 
numerically, we must deal with a finite number of samples of X (z) around 
the unit circle. Therefore we must, know the effect of such sampling on 
the time-domain sequence. This relationship is easy to obtain. 





N-1 
sure N Y x (RW (from (5.2)) 
k=0 
1 N-1 oo 
=F { X sir wn (from (5.15)) 
k=0 m=—0o 
or 
oo 1 N-1 oo oo 
£(n)-— Z z(m) yw” = X z(m) > 6(n—m-rN) 
m=- 0 m=—co r=- 
Jh n-m=rN 
~ |0, elsewhere 
oo oo 


= X 2 z(m)6(n — m — rN) 


r=—00 m=—0O 
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a THEOREM 1 


oO EXAMPLE 5.4 


Solution 


or 


#(n) = D z(n —rN) 2 ---a(n-- N) a(n) 4 z(n— N)4---- (5.16) 


r=- 


which means that when we sample X (z) on the unit circle, we obtain a 
periodic sequence in the time domain. This sequence is a linear combina- 
tion of the original x(n) and its infinite replicas, each shifted by multiples 
of +N. This is illustrated in Example 5.5. From (5.16) we observe that if 
a(n) = 0 for n < Oandn > N, then there will be no overlap or aliasing in 
the time domain. Hence we should be able to recognize and recover x(n) 
from z(n), that is, 


z(n) = £(n) forO<n<(N-1) 
or 


1, O<n<N-1 


x(n) = £(n)R(n) = £(n) f else 


where Ry (n) is called a rectangular window of length N. Therefore we 
have the following theorem. 


Frequency Sampling 
If x(n) is time-limited (i.e., of finite duration) to [0, N — 1], then N 
samples of X (z) on the unit circle determine X (z) for all z. 


Let zi(n) = {6,5, 4,3, 2, 1). Its DTFT Xı (e°) is sampled at 
T 


up T, k= 0,41,42,43,... 


to obtain a DFS sequence X2(k). Determine the sequence Z2(n), which is the 
inverse DFS of X2(k). 


Without computing the DTFT, the DFS, or the inverse DFS, we can evaluate 
a(n) by using the aliasing formula (5.16). 


oo 


£;(n) = EN zi(n — 4r) 


Thus 2(4) is aliased into (0), and z(5) is aliased into r(1). Hence 


&s(n) = (...,8,6,4,3,8,6,4,3,8,0,4,3,...) a 
T 
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O EXAMPLES Let z(n) = (0.7)" u(n). Sample its z-transform on the unit circle with N — 5, 
10, 20, 50 and study its effect on the time domain. 


Solution From Table 4.1 the z-transform of z(n) is 


1 z 
XG) = om T z OT 


We can now use MATLAB to implement the sampling operation 


X(k) = X(z)|,aesaeksn , k= 0,+1,+2,... 


|z| > 0.7 


and the inverse DFS computation to determine the corresponding time-domain 
sequence. The MATLAB script for N = 5 is shown below. 


>> N = 5; k = 0:1:N-1; % sample index 

>> wk = 2*pi*k/N; zk = exp(j*wk); % samples of z 

>> Xk = (zk) ./(zk-0.7); % DFS as samples of X(z) 
>> xn = real(idfs(Xk,N)); % IDFS 


>> xtilde = xn'* ones(1,8); xtilde = (xtilde(:))'; % Periodic sequence 
>> subplot (2,2,1); stem(0:39,xtilde);axis([0,40,-0.1,1.5]) 
>> xlabel(’n’); ylabel(’xtilde(n)’); title(’N=5’) 


The plots in Figure 5.3 clearly demonstrate the aliasing in the time domain, 
especially for N = 5 and N = 10. For large values of N the tail end of z(n) 


N=10 





xtilde(n) 
xtilde(n) 











xtilde(n) 
xtilde(n) 














FIGURE 5.3 Plots in Example 5.5 
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is sufficiently small to result in any appreciable amount of aliasing in practice. 
Such information is useful in effectively truncating an infinite-duration sequence 
prior to taking its transform. o 


RECON- Let x(n) be time-limited to [0, N — 1]. Then from Theorem 1 we should 
STRUCTION be able to recover the z-transform X(z) using its samples X(k). This is 
FORMULA given by 


X(z) = Z [z(n)] = Z [#(n)Rw(n)] 
=Z[IDFS{ X(k)  }Rn(n)] 
—— 
samples of X(z) 
The above approach results in the z-domain reconstruction formula. 


N-1 N-1 


X(z) = X z(n) "- Z &(n)z " 





1 N-1 2 N-1 " 
=F xo fw nz " 
k=0 0 
1 N-i - N-1 
= 2 X(h) ix (Wy*z7?) j 
k=0 0 
N-1 -kN ,—N 
1 = 1- W, z 
(ON zwf I Weed \ 
k=0 UUN a 


Since Wy*" = 1, we have 


X(2) = —— ae (5.17) 
N £i- Wee! 
THE DTFT The reconstruction formula (5.17) can be specialized for the discrete-time 
INTERPO- Fourier transform by evaluating it on the unit circle z = e””. Then 
LATION os , 
FORMULA zeja i27 X rs 
~ N 1 — ef 2ak/N e—jw 
k=0 
N-1 B — e-jeN 
= 2 X(k) N z EN —jw 
= {l-e e») 
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MATLAB 
IMPLEMEN- 
TATION 


Consider 
1 — e oN 1 — eilo- RN 
N{1- eNe} y fi estet] 


Ea EE d 
2xk il 
)3] 





16-38) | Nsin [(» — 228 
Let 
(w) A ARCA scite : an interpolating polynomial (5.18) 
Then 
TET 2rk 
X(&) = 2 X(k)® (^ B X) (5.19) 


This is the DTFT interpolation formula to reconstruct X(e?”) from its 
samples X (k). Since (0) = 1, we have that X (ei2"k/N) = X(k), which 
means that the interpolation is exact at sampling points. Recall the time- 
domain interpolation formula (3.33) for analog signals: 


oo 


zalt)= Y. z(n)sinc[F,(t — nT;)) (5.20) 


n--—00 


The DTFT interpolating formula (5.19) looks similar. 

However, there are some differences. First, the time-domain formula 
(5.20) reconstructs an arbitrary nonperiodic analog signal, while the 
frequency-domain formula (5.19) gives us a periodic waveform. Second, 
in (5.19) we use à Sinz) interpolation function instead of our more 
familiar “22 (sinc) function. Therefore the (w) function is sometimes 
called a digital sinc function, which itself is periodic. This is the function 
we observed in Example 5.2. 


The interpolation formula (5.19) suffers the same fate as that of (5.20) 
while trying to implement it in practice. One has to generate several 
interpolating polynomials (5.18) and perform their linear combinations 
to obtain the discrete-time Fourier transform X(e/") from its computed 
samples X(k). Furthermore, in MATLAB we have to evaluate (5.19) on 
a finer grid over 0 < w < 2r. This is clearly an inefficient approach. 
Another approach is to use the cubic spline interpolation function as an 
efficient approximation to (5.19). This is what we did to implement (5.20) 
in Chapter 3. However, there is an alternate and efficient approach based 
on the DFT, which we will study in the next section. 
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THE DISCRETE FOURIER TRANSFORM 
—_— ——————— —— 


The discrete Fourier series provided us a mechanism for numerically com- 
puting the discrete-time Fourier transform. It also alerted us to a poten- 
tial problem of aliasing in the time domain. Mathematics dictates that 
the sampling of the discrete-time Fourier transform result in & periodic 
sequence £(n). But most of the signals in practice are not periodic. They 
are likely to be of finite duration. How can we develop a numerically com- 
putable Fourier representation for such signals? Theoretically, we can take 
care of this problem by defining a periodic signal whose primary shape is 
that of the finite-duration signal and then using the DFS on this periodic 
signal. Practically, we define a new transform called the Discrete Fourier 
Transform (DFT), which is the primary period of the DFS. This DFT 
is the ultimate numerically computable Fourier transform for arbitrary 
finite-duration sequences. 

First we define a finite-duration sequence x(n) that has N samples 
over 0 < n € N —1 as an N-point sequence. Let &(n) be a periodic signal 
of period N, created using the N-point sequence x(n); that is, from (5.19) 


oo 


£(n)- Z r(n-rN) 


r-—o00 


This is à somewhat cumbersome representation. Using the modulo-N op- 
eration on the argument we can simplify it to 


£(n) = z(n mod N) (5.21) 


A simple way to interpret this operation is the following: if the argument 
n is between 0 and N — 1, then leave it as it is; otherwise add or sub- 
tract multiples of N from n until the result is between 0 and N — 1. Note 
carefully that (5.21) is valid only if the length of x(n) is N or less. Further- 
more, we use the following convenient notation to denote the modulo-N 
operation. 


z((n))u £ z(nmod N) (5.22) 
Then the compact relationships between z(n) and £(n) are 


£(n)— an) N iia meee) (5.23) 
z(n)— z(n)Rw(n) (Window operation) 


The rem(n,N) function in MATLAB determines the remainder after di- 
viding n by N. This function can be used to implement our modulo-N 
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operation when n 2 0. When n « 0, we need to modify the result to 
obtain correct values. This is shown below in the m=mod (n,N) function. 


function m - mod(n,N) 
% Computes m = (n mod N) index 


X4 m = mod(n,N) 
m = rem(n,N); 
m = mtN; 

m = rem(m,N); 


In this function n can be any integer array, and the array m contains the 
corresponding modulo-N values. 

From the frequency sampling theorem we conclude that N equispaced 
samples of the discrete-time Fourier transform X (e") of the N-point se- 
quence x(n) can uniquely reconstruct X (e^). These N samples around 
the unit circle are called the discrete Fourier transform coefficients. Let 
X(k) = DFS z(n), which is a periodic (and hence of infinite duration) se- 
quence. Its primary interval then is the discrete Fourier transform, which 
is of finite duration. These notions are made clear in the following defi- 
nitions. The Discrete Fourier Transform of an N-point sequence is given 
by 


x(k) Ê DFT [e(n)] = B () OS ESN-I L X()RA() 
or 
N-1 
X(k) - So (00WE, OSkSN-1 (5.24) 
n=0 


Note that the DFT X(k) is also an N-point sequence, that is, it is 
not defined outside of 0 < k € N — 1. From (5.23) X(k) = X((k))u; 
that is, outside the 0 <k < N —1 interval only the DFS X(k) is de- 
fined, which of course is the periodic extension of X (k). Finally, X(k) = 
X(k)Rw(k) means that the DFT X(k) is the primary interval of X(k). 

The inverse discrete Fourier transform of an N-point DFT X (k) is 
given by 


z(n) Ê IDFT [X (k)) = £(n)Rw(n) 


or 


N-1 
z(n)= x V xw, OSn<N-1 (5.25) 
k=0 


se ae ee 
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Once again z(n) is not defined outside 0 € n € N —1. The extension of 
z (n) outside this range is Z(n). 


MATLAB It is clear from the discussions at the top of this section that the DFS is 
IMPLEMEN- practically equivalent to the DFT when 0 < n < N — 1. Therefore the 
TATION implementation of the DFT can be done in a similar fashion. If z(n) and 
X(k) are arranged as column vectors x and X, respectively, then from 
(5.24) and (5.25) we have 
X-wW NX 
1 (5.26) 
where Wy is the matrix defined in (5.7) and will now be called a DFT 
matriz. Hence the earlier dfs and idfs MATLAB functions can be renamed 
as the dft and idft functions to implement the discrete Fourier transform 
computations. 
function [Xk] = dft(xn,N) 
% Computes Discrete Fourier Transform 
4 ------7-------- -—-------2---------2--- 
% (Xk] = dft(xn,N) 
4 Xk = DFT coeff. array over O <= k <= N-1 
% xn = N-point finite-duration sequence 
% N= Length of DFT 
4 
n = (0:1:N-1]; % row vector for n 
k = [0:1:N-1]; % row vecor for k 
WN = exp(-j*2*pi/N); % Wn factor 
nk = n'*k; % creates a N by N matrix of nk values 
WNnk = WN .^ nk; % DFT matrix 
Xk = xn * WNnk; % row vector for DFT coefficients 
function [xn] = idft(Xk,N) 
% Computes Inverse Discrete Transform 
* —---22222-22-22-----—————-----—-—-—-—---— 
% [xn] = idft(Xk,N) 
X xn = N-point sequence over 0 <= n <= N-i 
% Xk = DFT coeff. array over 0 <= k <= N-1 
% N= length of DFT 
* 
n = [0:1:N-11; % row vector for n 
k = [0:1:N-1]; % row vecor for k 
WN = exp(-j*2*pi/N); % Wn factor 
nk = n'*k; % creates a N by N matrix of nk values 
WNnk = WN .^ (-nk); % IDFT matrix 
xn = (Xk * WNnk)/N; % row vector for IDFT values 
pe Sa et SE a SS 
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oO EXAMPLE 5.6 Let x(n) be a 4-point sequence: 


1, O0O<n<3 
a(n) = 
0, otherwise 


a. Compute the discrete-time Fourier transform X (e^) and plot its mag- 
nitude and phase. , 
b. Compute the 4-point DFT of z(n). 


Solution a. The discrete-time Fourier transform is given by 
3 
X(e”) = ise? =1+ e + ei + e 9 
0 
al -e4 — sin(Qw) -j3w/2 
l-e-j"  sin(w/2) 














Hence 
ju in(2w 
jx] = E 
and 
239» sin(2w) 
zx (5 z 2' when sin(u/2) 20 
ES sin(24) 
2 an, when sina) 


The plots are shown in Figure 5.4. 
b. Let us denote the 4-point DFT by X4 (k). Then 


3 
X«4(k) = J ewi"; k = 0,1,2,3; Wa = eih = —j 
n=0 
These calculations are similar to those in Example 5.1. We can also use MATLAB 
to compute this DFT.” 


>> x= [1,1,1,1]; N = 4; 
>> X = dft(x,N); 
>> magX = abs(X), phaX = angle(X)*180/pi 


magk = 
4.0000 0.0000 0.0000 0.0000 

phaX = 
0 -134.9810 -90.0000 -44.9979 

Hence 


Xalk) = {4,0,0,0} 
1 


Note that when the magnitude sample is zero, the corresponding angle is not 
zero. This is due to a particuler algorithm used by MATLAB to compute the 
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Solution 


The Discrete Fourier Transform 


Magnitude of the DTFT 






0.6 0.8 1 1.2 
frequency in pi units 


Angle of the DTFT 




















1.6 1.8 






0 0.2 0.4 06 0.8 1 12 14 
frequency in pi units 


FIGURE 5.4 The DTFT plots in Ezample 5.6 


angle part. Generally these angles should be ignored. The plot of DFT values 
is shown in Figure 5.5. The plot of X (e) is also shown as a dashed line for 
comparison. From the plot in Figure 5.5 we observe that X4 correctly gives 4 
samples of X (e), but it has only one nonzero sample. Is this surprising? By 
looking at the 4-point x(n), which contains all 1’s, one must conclude that its 
periodic extension is 


£(n) =1, Vn 


which is a constant (or a DC) signal. This is what is predicted by the DFT 
X4(k), which has a nonzero sample at k = 0 (or w = 0) and has no values at 
other frequencies. D 


How can we obtain other samples of the DTFT X (e^)? 


It is clear that we should sample at dense (or finer) frequencies; that is, we 
should increase N. Suppose we take twice the number of points, or N=8 
instead of 4. This we can achieve by treating z(n) as an 8-point sequence by 
appending 4 zeros. 


x(n) = (1,1,1,1,0,0,0,0) 
t 





























FIGURE 5.5 The DFT plots of Example 5.6 


This is a very important operation called a zero-padding operation. This oper- 
ation is necessary in practice to obtain a dense spectrum of signals as we shall 
see. Let Xa (k) be an 8-point DFT, then 


7 
Xs (k) =$ 2(n)Ws"; k=0,1,...,7; We e i7/ 
n=0 
in this case the frequency resolution is w = 27/8 = n/A. 
>> x = [1,1,1,1, zeros(1,4)]; N = 8; 
>> X = dft(x,N); 
>> magX = abs(X), phaX = angle(X)*180/pi 
magi = 
4.0000 2.6131 0.0000 1.0824 0.0000 1.0824 0.0000 2.6131 
phax = 
0 -67.5000 -134.9810 -22.5000 -90.0000 22.5000. -44.9979 67.5000 


Hence 


Xs (k) = (4, 2.61316 75" 5^, 0, 1.0824e7725", 0, 1.08247? 5, 
T 


0, 2.6131e/97 5^ 
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Magnitude of the DFT: N=8 
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FIGURE 5.6 The DFT plots of Example 5.7: N =8 


which is shown in Figure 5.6. Continuing further, if we treat a(n) as a 16-point 
sequence by padding 12 zeros, such that 


a(n) = {1,1,1,1,0,0,0,0, 0,0, 0,0, 0,0, 0,0} 
T 


then the frequency resolution is w1 = 27/16 = 7/8 and Wie = e777/*, Therefore 
we get a more dense spectrum with spectral samples separated by 7/8. The 
sketch of X1s (k) is shown in Figure 5.7. B 


Comments: Based on the last two examples there are several comments 
that we can make. 


1. Zero-padding is an operation in which more zeros are appended to 
the original sequence. The resulting longer DFT provides closely spaced 
samples of the discrete-time Fourier transform of the original sequence. 
In MATLAB zero-padding is implemented using the zeros function. 

2. In Example 5.6 all we needed to accurately plot the discrete-time 
Fourier transform X (e/*) of x(n) was X4 (k), the 4-point DFT. This is 
because z(n) had only 4 nonzero samples, so we could have used the inter- 
polation formula (5.19) on X4 (k) to obtain X (e^). However, in practice, 
it is easier to obtain Xs (k) and X1 (k), and so on, to fill in the values 
of X (e^) rather than using the interpolation formula. This approach can 
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EXAMPLE 5.8 


Magnitude of the DFT: N=16 








FIGURE 5.7 The DFT plots of Example 5.7: N = 16 


be made even more efficient using fast Fourier transform algorithms to 
compute the DFT. 

3. The zero-padding gives us a high-density spectrum and provides 
a better displayed version for plotting. But it does not give us a high- 
resolution spectrum because no new information is added to the signal; 
only additional zeros are added in the data. 

4. To get a high-resolution spectrum, one has to obtain more data 
from the experiment or observations (see Example 5.8 below). There are 
also other advanced methods that use additional side information or non- 
linear techniques. 


To illustrate the difference between the high-density spectrum and the high- 
resolution spectrum, consider the sequence 


x(n) = cos (0.4877) + cos (0.52) 
We want to determine its spectrum based on the finite number of samples. 


a. Determine and plot the discrete-time Fourier transform of z(n), 0< 
n € 10. 

b. Determine and plot the discrete-time Fourier transform of z(n), O< 
n € 100. 


SST 
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Solution 


We could determine analytically the discrete-time Fourier transform in each 
case, but MATLAB is a good vehicle to study these problems. 


a. We can first determine the 10-point DFT of x(n) to obtain an estimate 
of its discrete-time Fourier transform. 


n = [0:1:99]; x = cos(0.48*pi*n)*cos(0.52*pi*n); 

ni = [0:1:9] ;y1 = x(1:1:10); 

subplot (2,1,1) ;stem(ni,y1); title(’signal x(n), 0 <= n <= 9’) ;xlabel(’n’) 
Yi = dft(y1,10); magY1 = abs (¥1(1:1:6)); 

ki = 0:1:5 ;wi = 2*pi/10*k1; 

subplot (2,1,2);plot(wi/pi,magY1) ;title(’Samples of DIFT Magnitude’) ; 
xlabel('frequency in pi units’) 


The plots in Figure 5.8 show there aren’t enough samples to draw any conclu- 
sions. Therefore we will pad 90 zeros to obtain a dense spectrum. 


n2 = [0:1:99]; y2 = [x(1:1:10) zeros(1,90)]; 

subplot(2,1,1) ;stem(n2,y2) ;title(’signal x(n), 0 <= n <= 9 + 90 zeros’); 
xlabel(’n’) i 

Y2 =dft(y2,100); magY2 = abs (Y2(1:1:51)); 

k2 = 0:1:50; w2 = 2*pi/100*k2; 

subplot (2,1,2); plot(w3/pi,magY3); title(’DIFT Magnitude’); 
xlabel('frequency in pi units’) 


signal x(n), 0 <= n <= 9 














frequency in pi units 
FIGURE 5.8 Signal and its spectrum in Example 5.8a: N = 10 
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signal x(n), 0 <= n <= 9 + 90 zeros 
nas | TT -—T-7 T € T—t T^ a T 
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FIGURE 5.9 Signal and its spectrum in Example 5.8a: N = 100 


Now the plot in Figure 5.9 shows that the sequence has a dominant frequency 
at w = 0.57. This fact is not supported by the original sequence, which has two 
frequencies. The zero-padding provided a smoother version of the spectrum in 
Figure 5.8. 

b. To get better spectral information, we will take the first 100 samples of 
x(n) and determine its discrete-time Fourier transform. 


>> subplot(2,1,1); stem(n,x); 

>> title(’signal x(n), 0 <= n <= 997); xlabel(’n’) 

>> X = dft(x,100); magX = abs(X(1:1:51)); 

>> k = 0:1:50; w = 2*pi/100*k; 

>> subplot (2,1,2); plot(w/pi,magX) ; title(’DIFT Magnitude’); 
>> xlabel(’frequency in pi units’) 


Now the discrete-time Fourier transform plot in Figure 5.10 clearly shows two 
frequencies, which are very close to each other. This is the high-resolution spec- 
trum of x(n). Note that padding more zeros to the 100-point sequence will result 
in a smoother rendition of the spectrum in Figure 5.10 but will not reveal any 
new information. Students are encouraged to verify this. ü 





signal x(n), 0 «- n «- 99 
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FIGURE 5.10 Signal and its spectrum in Example 5.8b: N = 100 


PROPERTIES OF THE DISCRETE FOURIER TRANSFORM 
—————————83— ! 


The DFT properties are derived from those of the DFS because mathe- 
matically DFS is the valid representation. We discuss several useful prop- 
erties, which are given without proof. These properties also apply to the 
DFS with necessary changes. Let X(k) be an N-point DFT of the se- 
quence x(n). Unless otherwise stated, the N-point DFTs will be used in 
these properties. 


1. Linearity: The DFT is a linear transform 
DFT [azı (n) + bro(n)} = a DFT [zi (n)| + b DFT [z2(n)] (5.27) 


Note: If zı(n) and z2(n) have different durations—that is, they are 
Nı-point and N-point sequences, respectively—then choose N3 = 
max(Nı, N2) and proceed by taking N3-point DFTs. 

2. Circular folding: If an N-point sequence is folded, then the result 
z(—n) would not be an N-point sequence, and it would not be possible 
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Original sequence 


to compute its DFT. Therefore we use the modulo-N operation on the 
argument (—n) and define folding by 10 





(5.28) 


x(n) 


This is called a circular folding. To visualize it, imagine that the se- | | iz io i ia 1 9 
quence z(n) is wrapped around a circle in the counterclockwise direc- Lou dne ue a Ll cu 

tion so that indices n = 0 and n = N overlap. Then z((—n))w can CIEGO SE LÁ 7 8 9 10 
be viewed as a clockwise wrapping of z(n) around the circle; hence the 
name circular folding. In MATLAB the circular folding can be achieved by na END cen. 
x=x(mod(-n,N)+1). Note that the arguments in MATLAB begin with 1. 10 

Then its DFT is given by 











(5.29) 


x(-n mod 11) 


o m b coco C 


X(0), k 
1 


X(N EE k), 


DFT [z ((—n)) vy] = X ((-5))y = { a <N-1 


^ 


5 6 7 8 9 10 


C)  EXAMPLES9 Let z(n) = 10(0.8)", O<n< 10. 0 1 2 3 
n 


a. Determine and plot z ((—n)),;. ; mu 
b. Verify the circular folding property. FIGURE 5.11 Circular folding in Example 5.9a 


Solution a. MATLAB Script —— —— —— Real(DET[x(n)]) Imag(DFTI[x(n)]) 


>> n = 0:100; x = 10*(0.8) .^ n; 

>> y = x(mod(-n,11)*1); 

»» subplot(2,1,1); stem(n,x); title('Original sequence?) 

>> xlabel(/n!); ylabel(’x(n)’); 

>> subplot (2,1,2); stem(n,y); title(’Circularly folded sequence’) 


o 38 8:8 8 
8 32 o 28 B 


>> xlabel(’n’); ylabel(^x(-n mod 10)’); 10 

Mg MEME. aM. A11i11ÉiÉ( 

The plots in Figure 5.11 show the effect of circular folding. ? T i x n 
b. MATLAB Script. ———————— —————————— 

gle deere rs ditis in ReaKDFTIx(-))11D 26 Imag(DFTIx(-))11]) 

>> subplot(2,2,1); stem(n,real(X)); 

>> title(’Real{DFT[x(n)]}’); xlabel(’k’); ps 10 

>> subplot(2,2,2); stem(n,imag(X)); 30 

>> title(?Imag{DFT[x(n)]}’); xlabel(’k’); 0 

>> subplot(2,2,3); stem(n,real(Y)); 7 

>> title(’Real{DFT[x((-n))11]}?); xlabel(’k’); 10 -10 

»» subplot(2,2,4); stem(n,imag(Y)); 0 

>> title(C Imag[DFT[x((-2))11))5); xlabel(’k’); : -20 

an e a M 0 5 10 0 5 10 

k k 
The plots in Figure 5.12 verify the property. ü FIGURE 5.12 Circular folding property in Example 5.9b 
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3. Conjugation: Similar to the above property we have to introduce 
the circular folding in the frequency domain. 


DFT [2*(n)] = X* (-E)u (5.30) 


4, Symmetry properties for real sequences: Let z(n) be a real-valued 
N-point sequence. Then x(n) = x*(n). Using the above property, 


X(k) = X* ((-k))w (5.31) 


This symmetry is called a circular conjugate symmetry. It further implies 
that 


Re [X(k)] = Re [X ((-k)) y] ==> Circular-even sequence 

Im [X(k)] = — Im [X ((N — k)) y] = Circular-odd sequence 

IX (k)| = |X ((-k)) nl ==> Circular-even sequence 

LX(k) = —£X ((—k))y => Circular-odd sequence 
(5.32) 


Comments: 1. Observe the magnitudes and angles of the various DFTs 
in Examples 5.6 and 5.7. They do satisfy the above circular symmetries. 
These symmetries are different than the usual even and odd symmetries. 
To visualize this, imagine that the DFT samples are arranged around a 
circle so that the indices k = 0 and k = N overlap; then the samples 
will be symmetric with respect to k = 0, which justifies the name circular 
symmetry. 

2. The corresponding symmetry for the DFS coefficients is called the 
periodic conjugate symmetry. 

3. Since these DFTs have symmetry, one needs to compute X (k) only 
for 


k=O Zi N even 
or for 
k=0,1,..., ——; N odd 


This results in about 50% savings in computation as well as in storage. 
4. From (5.30) 


X(0) = X*((-0))w = X*(0) 


which means that the DFT coefficient at k = 0 must be a real number. 
But k = 0 means that the frequency wk = kw; = 0, which is the DC 
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frequency. Hence the DC coefficient for a real-valued x(n) must be a real 
number. In addition, if N is even, then N/2 is also an integer. Then from 


7 GE 


which means that even the k — N/2 component is also real-valued. This 
component is called the Nyquist component since k = N/2 means that 
the frequency wy/2 = (N/2)(2n/N) = v, which is the digital Nyquist 
frequency. 


The real-valued signals can also be decomposed into their even and odd 
components, z,(n) and z, (n), respectively, as discussed in Chapter 2. 
However, these components are not N-point sequences and therefore we 
cannot take their N-point DFTs. Hence we define a new set of components 
using the circular folding discussed above. These are called circular-even 
and circular-odd components defined by 


^ J z(0), n=0 
Lec (n) = 4 (x(n) + 2 ((—n))y] ad D ede. 1 <n<N-1 
A 0, n=0 
zo. (n) = 4 [x(n) - z ((-n))y] = NU em 
(5.33) 
Then 
DFT [ec (n)] = Re[X(&)] = Re [X ((—')) y] (5.34) 


DFT [zoe (n)] = Im [X(k)] = Im [X ((—)) 1 


Implication: If x(n) is real and circular-even, then its DFT is also real 
and circular-even. Hence only the first 0 < n « N/2 coefficients are 
necessary for complete representation. 

Using (5.33), it is easy to develop a function to decompose an N-point 
sequence into its circular-even and circular-odd components. The follow- 
ing circevod function uses the mod function given earlier to implement 
the n MOD N operation. 


Qf mene nn r 
4 {xec, xoc) = circevod(x) 
% 
if any(imag(x) ~= 0) 
error(’x is not a real sequence’) 


ee ee eT 
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end 

N = length(x); n = 0:(N-1); 
xec = 0.5*(x + x(mod(-n,N)+1)); 
xoc = 0.5*(x - x(mod(-n,N)+1)); 


Let z(n) = 10(0.8)", O<n< 10 as in Example 5.9. 


a. Decompose and plot the tec(n) and zoc(n) components of x(n). 
b. Verify the property in (5.34). 


a. MATLAB Script ——__——————— 
>> n = 0:10; x = 10*(0.8) .^ n; 
>> [xec,xoc] = circevod(x); 
>> subplot(2,1,1); stem(n,xec); title('Circular-even component’) 
>> xlabel(’n’); ylabel(’xec(n)’); axis([-0.5,10.5,-1,11]) 
>> subplot(2,1,2); stem(n,xoc); title(’Circular-odd component’) 
>> xlabel(’n’); ylabel(’xoc(n)’); axis([-0.5,10.5,-4,4]) 





The plots in Figure 5.13 show the circularly symmetric components of z(n). 
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FIGURE 5.13 Circular-even and circular-odd components of the sequence in Ez- 
ample 5.10a 
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b. MATLAB Script 
>> X = dft(x,11); Kec = dft(xec,11); Xoc = dft(xoc,11); 
>> subplot(2,2,1); stem(n,real(X)); axis([-0.5,10.5,-5,50]) 
>> title('Real(DFT[x(n)])); xlabel(’k’); 
>> subplot (2,2,2); stem(n,imag(X)); axis([-0.5,10.5,-20,20]) 
>> title( Imag(DFT[x(n)])?); xlabel(’k’); 
>> subplot (2,2,3); stem(n,real(Xec)); axis([-0.5,10.5,-5,50]) 
>> title(’DFT[xec(n)J’); xlabel(’k’); 
>> subplot (2,2,4); stem(n,imag(Xoc)); axis([-0.5,10.5,-20,201) 
>> title(’DFT{xoc(n)]’); xlabel(’k’); 


From the plots in Figure 5.14 we observe that the DFT of £ec(n) is the same as 
the real part of X(k) and that the DFT of Zoc(n) is the same as the imaginary 
part of X(k). n 


A similar property for complex-valued sequences is explored in Exer- 
cise 5.10. 

5. Circular shift of a sequence: If an N-point sequence is shifted in 
either direction, then the result is no longer between 0 < n < N-1. 
Therefore we first convert x(n) into its periodic extension £(n), and then 
shift it by m samples to obtain 


&(n — m) 2 z((n— m))u (5.35) 
RealDFT[x(n)]} imag{DFT[x(n)}} 

50 20 
40 

10 
30 

20 0 

10 -10 
o 

0 5 10 a5 5 10 
k k 
DFT[xec(n)] DFT[xoc(n)] 
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Br 10 
30 
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D) 
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k k 


FIGURE 5.14 Plots of DFT symmetry properties in Example 5.106 
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This is called a periodic shift of z(n). The periodic shift is then converted 
into an N-point sequence. The resulting sequence 


&(n — m)Ra(n) = z (n — m))y R(n) (5.36) 


is called the circular shift of x(n). Once again to visualize this, imagine 
that the sequence z(n) is wrapped around a circle. Now rotate the circle 
by k samples and unwrap the sequence from 0 € n € N - 1. Its DFT is 
given by 


DFT [z ((n — m))y R(n)] = WS" X(E) (5.37) 


Let x(n) = 10(0.8)", O<n< 10 be an 11-point sequence. 


a. Sketch z ((n + 4)),, Ru (n), that is, a circular shift by 4 samples toward 
the left. 

b. Sketch z ((n — 3)),, Ris(n), that is, a circular shift by 3 samples toward 
the right, where x(n) is assumed to be a 15-point sequence. 


We will use a step-by-step graphical approach to illustrate the circular shifting 
operation. This approach shows the periodic extension £(n) = z ((n))y of x(n), 
followed by a linear shift in £(n) to obtain Ž (n — m) = z ((n — m)) y, and finally 
truncating £ (n — m) to obtain the circular shift. 


a. Figure 5.15 shows four sequences. The top-left shows z(n), the bottom- 
left shows Z(n), the top-right shows £ (n +4), and finally the bottom-right 
shows 2((n+4)),, Rii(n). Note carefully that as samples move out of the 
[0, N — 1] window in one direction, they reappear from the opposite direction. 
This is the meaning of the circular shift, and it is different from the linear shift. 

b. In this case the sequence x(n) is treated as a 15-point sequence by 
padding 4 zeros. Now the circular shift will be different than when N = 11. 
This is shown in Figure 5.16. In fact the circular shift z ((n — 3)),5 looks like a 
linear shift x(n — 3). a 


To implement a circular shift, we do not have to go through the 
periodic shift as shown in Example 5.11. It can be implemented directly 
in two ways. In the first approach, the modulo-N operation can be used 
on the argument (n — m) in the time domain. This is shown below in the 
cirshftt function. 


function y = cirshftt(x,m,N) 
% Circular shift of m samples wrt size N in sequence x: (time domain) 


% [y] = cirshftt(x,n,N) 

% y = output sequence containing the circular shift 
% x = input sequence of length <= N 

% m = sample shift 

4% N = size of circular buffer 

% Method: y(n) = x((n-m) mod N) 


cok ot e et 


146 


Chapter5 ™ THE DISCRETE FOURIER TRANSFORM 


Periodic shift 





FIGURE 5.15 Graphical interpretation of circular shift, N = 11 


Original x(n) Periodic shift 





FIGURE 5.16 Graphical interpretation of circular shift, N = 15 


ae ers onea SEE TS 


Properties of the Discrete Fourier Transform 


1 


47 


O EXAMPLE 5.12 


Solution 


% Check for length of x 
if length(x) > N 
error(’N must be >= the length of x’) 
end 
x = [x zeros(1,N-length(x))]; 
n = (0:1:N-1]; 
n = mod(n-m,N) ; 
y = x(nti); 


In the second approach, the property 5.37 can be used in the frequency 
domain. This is explored in Exercise 5.12. 


Given an 11-point sequence z(n) = 10 (0.8)", O<n< 10, determine and plot 
z ((n — 6),5- 


MATLAB Script ——— 
>> n = 0:10; x = 10*(0.8) .^ n; 

>> y = cirshftt (x,6,15); 

>> n = 0:14; x = (x, zeros(1,4)]; 

>> subplot(2,1,1); stem(n,x); title(’Original sequence’) 

>> xlabel(’n’); ylabel(’x(n)’); 

>> subplot(2,1,2); stem(n,y); 

>> title(’Circularly shifted sequence, N=15’) 

>> xlabel(’n’); ylabel(’x((n-6) mod 15)’); 


The results are shown in Figure 5.17. o 


6. Circular shift in the frequency domain: This property is a dual of 
the above property given by 


DFT [Ws ^^z(n)] = X ((k — £)u Ruhk) (5.38) 


7. Circular convolution: A linear convolution between two N-point 
sequences will result in a longer sequence. Once again we have to restrict 
our interval to 0 € n € N - 1. Therefore instead of linear shift, we 
should consider the circular shift. A convolution operation that contains 
a circular shift is called the circular convolution and is given by 


N-1 


zin) Q n(n) = Y, ailm)a2((n—m))y, OSnSN-1 (539 


m=0 


Note that the circular convolution is also an N-point sequence. It has a 
structure similar to that of a linear convolution. The differences are in 
the summation limits and in the N-point circular shift. Hence it depends 
on N and is also called an N-point circular convolution. Therefore the 
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FIGURE 5.17 Circularly shifted sequence in Example 5.12 


use of the notation @) is appropriate. The DFT property for the circular 
convolution is 


DFT [n Q) z2(n)| = Xi(k) - Xo(k) (5.40) 


An alternate interpretation of this property is that when we multiply two 
N-point DFTs in the frequency domain, we get the circular convolution 
(and not the usual linear convolution) in the time domain. 


Let zi(n) = {1,2,2} and z2(n) = (1,2, 3,4}. Compute the 4-point circular 
convolution zi (n) za(n). 


Note that z1(n) is a 3-point sequence, hence we will have to pad one zero to 
make it a 4-point sequence before we perform the circular convolution. We will 
solve this problem in the time domain as well as in the frequency domain. In 
the time domain we will use the mechanism of circular convolution, while in the 
frequency domain we will use the DFTs. 


e Time-domain approach: The 4-point circular convolution is given by 


3 
zi(n) (4) (9) = Y m (m) 22 (n — m), 


m=0 


AS 
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Thus we have to create a circularly folded and shifted sequence z2 ((n — m)) y, 
multiply it sample-by-sample with z1 (m), add the samples to obtain the circular 
convolution value for that n, and then repeat the procedure for 0 < n € 3. 
Consider 


zi(m) = (1, 2, 2, 0) and zo(m) = {1, 2, 3, 4} 
forn-0 


3 3 
onm) -za ((0 mJ, = SOUL, 2, 2, 0) - (1, 4, 3, 2] 


m=0 m-0 


il 


3 
350,8 6, 0}=15 


m=0 


forn=1 


3 3 
Y sı(m) - 22 (0 — m), = Y 5, 2, 2, 0) - (2, 1, 4, 3)] 


m=0 m=0 
3 
=>) {2, 2, 8, o}=12 
m=0 


forn=2 


3 3 
Y 21(m) 22 ((2- m), = D> [{1, 2, 2, 0) - (3, 2, 1, 4)] 


m=0 m=0 
3 
255. 4,2,0)-9 
m=0 


forn =3 


3 3 
Sam) - 22 (8 — m), = J (GL, 2, 2, 0) - (4, 3, 2, 1)] 


m=0 m=0 
3 
=) {4, 6, 4, 0}=14 
m=0 


Hence 


zi(n) (4) za(n) = (15, 12, 9, 14) 


e Frequency-domain approach: In this approach we first compute 4-point 
DFTs of zi(n) and x2(n), multiply them sample-by-sample, and then take the 
inverse DFT of the result to obtain the circular convolution. 
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DFT of zi(n) 


zi(n) = {1,2,2,0} => Xi(k) = (5, -1—- j2, 1, —1 + j2} 
DFT of z2(n) 
z2(n) = {1,2,3,4} => Xa(k) = (10, —2 + j2, -2, -2— j2} 
Now 
X1(k) - X2(k) = {50, 6 + j2, —2, 6 — j2} 
Finally after IDFT, 


ai(n) (4) z2(n) = (15, 12, 9, 14} 


which is the same as before. Oo 


Similar to the circular shift implementation, we can implement the circular 
convolution in a number of different ways. The simplest approach would be 
to implement (5.39) literally by using the cirshftt function and requir- 
ing two nested for...end loops. Obviously, this is not efficient. Another 
approach is to generate a sequence z ((n — m))y for each n in [0, N — 1] 
as rows of a matrix and then implement (5.39) as a matrix-vector multi- 
plication similar to our dft function. This would require one for...end 
loop. The following circonvt function incorporates these steps. 


function y = circonvt(x1,x2,N) 
% N-point circular convolution between x1 and x2: (time-domain) 
Yj new enn nn nnn nnn nnn anne nnn nnn nnn nen nnn nnn nnn nnn nena anne n= 
% Ly] = circonvt(x1,x2,N) 
% y = output sequence containing the circular convolution 
% x1 = input sequence of length N1 <= N 
% x2 = input sequence of length N2 <= N 
% N = size of circular buffer 
% Method: y(n) = sum (xi(m)*x2((n-m) mod N)) 
% Check for length of x1 
if length(xi) > N 
error(’N must be >= the length of x1’) 
end 
% Check for length of x2 
if length(x2) > N 
error(’N must be >= the length of x2’) 
end 
xi=(x1 zeros(1,N-length(x1))]; 
x2-[x2 zeros(1,N-length(x2))]; 
m = [0:1:N-1); 
x2 = x2(mod(-m,N)+1); 
H = zeros(N,N); 
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Solution 


EE mel 


for n = 1:1:N 

H(n,:) = cirshftt(x2,n-1,N); 
end 

y = x1*H'; 


The third approach would be to implement the frequency-domain opera- 
tion (5.40) using the dft function. This is explored in Exercise 5.15. 


Let us use MATLAB to perform the circular convolution in Example 5.13. 
The sequences are z1(n) = {1,2,2} and zz(n) = (1,2,3,4). 


>> xi = [1,2,2]; x2 = [1,2,3,4]; 
>> y = circonvt(xi, x2, 4) 


y = 
15 12 9 14 
Hence 
zi (n) (4) z2(n) = (15, 12, 9, 14} 
as before. ü 


In this example we will study the effect of N on the circular convolution. Obvi- 
ously, N 2 4; otherwise there will be à time-domain aliasing for z2(n). We will 
use the same two sequences from Example 5.13. 


a. Compute az1(n) (5) Z2(n). 
b. Compute zı (n) (6) za (n). 
c. Comment on the results. 


The sequences are z;(n) = {1,2,2} and zz(n) = (1,2,3,4). Even though the 
sequences are the same as in Example 5.14, we should expect different results 
for different values of N. This is not the case with the linear convolution, which 
is unique, given two sequences. 


a. 5-point circular convolution: 
>> xi [1,2,2]; x2 = [1,2,3,4]; 
>> y = circonvt(xi, x2, 5) 


y= 
9 4 9 14 14 


Hence 


zi(n) (S) z2(n) = {9, 4, 9, 14, 14} 


Soe oan ___ 
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b. 6-point circular convolution: 


>> xi = [1,2,2]; x2 = [1,2,3,4]; 
>> y = circonvt(xi, x2, 6) 


zi(n) (8) z2(n) = (1, 4, 9, 14, 14, 8) 


c. A careful observation of 4-, 5-, and 6-point circular convolutions from 
this and the previous example indicates some unique features. Clearly, an N- 
point circular convolution is an N-point sequence. However, some samples in 
these convolutions have the same values, while other values can be obtained 
as a sum of samples in other convolutions. For example, the first sample in 
the 5-point convolution is a sum of the first and the last sample of the 6-point 
convolution. The linear convolution between z;(n) and z2(n) is given by 


a(n) * x2(n) = (1, 4, 9, 14, 14, 8} 


which is equivalent to the 6-point circular convolution. These and other issues 
are explored in the next section. Dn 


8. Multiplication: This is the dual of the circular convolution prop- 
erty. It is given by 


DFT [zi (2) - 22(n)] = x (k) @ x«(&) (5.41) 


in which the circular convolution is performed in the frequency domain. 
The MATLAB functions developed for circular convolution can also be 
used here since X, (k) and X» (k) are also N-point sequences. 

9. Parseval's relation: This relation computes the energy in the fre- 
quency domain. 


N-1 . 1 N-1 
E, = Y iz) = N Y Xk)? (5.42) 
n=0 k=0 


The quantity Lx is called the energy spectrum of finite-duration se- 


ae Y NEP 
quences. Similarly, for periodic sequences, the quantity | N | is called 
the power spectrum. 
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One of the most important operations in linear systems is the linear convo- 
lution. In fact FIR filters are generally implemented in practice using this 
linear convolution. On the other hand, the DFT is a practical approach 
for implementing linear system operations in the frequency domain. As we 
shall see later, it is also an efficient operation in terms of computations. 
However, there is one problem. The DFT operations result in a circular 
convolution (something that we do not desire), not in a linear convolution 
that we want. Now we shall see how to use the DFT to perform a linear 
convolution (or equivalently, how to make a circular convolution identical 
to the linear convolution). We alluded to this problem in Example 5.15. 

Let x(n) be an Ni-point sequence and let z;(n) be an N2-point 
sequence. Define the linear convolution of z; (n) and x(n) by za(n), that 
is, 


x3(n) = zi(n) + Z2(n) (5.43) 
oo Ny,-1 
= D5 n(m(n-k)- 35 ni (E)za(n — k) 
kz-—-oo 0 


Then za3(n) is a (Ny + No — 1)-point sequence. If we choose N = 
max(N,, N2) and compute an N-point circular convolution zi(n) Q 
Z2(n), then we get an N-point sequence, which obviously is different 
from zs(n). This observation also gives us a clue. Why not choose 
N = N, + No — 1 and perform an (Ni + No — 1)-point circular con- 
volution? Then at least both of these convolutions will have an equal 
number of samples. 

Therefore let N = N; + No — 1 and let us treat x(n) and zo(n) as 
N-point sequences. Define the N-point circular convolution by za4(n). 


aa(n) = 21(n) (N) z2(n) (5.44) 
N-1 
= lx x1 (k)z2((n - J Ry(n) 


m=0 


N-1 oo 
x z(k) >> a&-e-ev) Rn(n) 


m=0 r=—00 


co  Ni-Àl 


35 Yln()zs(n - k - rN) | Rw(n) 


r=—oo m=0 


z3(n-rN) 
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ERROR 
ANALYSIS 





- | Y z3(n — a) Rynin) using (5.43) 


=—00 


This analysis shows that, in general, the circular convolution is an aliased 
version of the linear convolution. We observed this fact in Example 5.15. 
Now since z3(n) is an N = (Ni + Nz — 1)-point sequence, we have 


za(n) = za(n); O<n<(N-1) 
which means that there is no aliasing in the time domain. 


Conclusion: If we make both z;(n) and zs(n) N = Ni + Nz — 1 point 
sequences by padding an appropriate number of zeros, then the circular 
convolution is identical to the linear convolution. 


Let z1(n) and r2(n) be the two 4-point sequences given below. 
a(n) = (1, 2 2, 1}, 22(n) = {1, -1, -1, 1} 
a. Determine their linear convolution za(n). 
b. Compute the circular convolution z4(n) so that it is equal to za(n). 
We will use MATLAB to do this problem. 


a. MATLAB Script... LÀ ———————————————— 
>> xi = [1,2,2,1]; x2-[1,-1,-1,1]; 
>> x3 = conv(x1,x2) 
x3 = 1 1 -1 -2 -1 1 1 


A 


Hence the linear convolution x3(n) is a 7-point sequence given by 
z3(n) = {1,1,—1,-2,-1,1, 1} 
b. We will have to use N > 7. Choosing N = 7, we have 


>> x4 = circonvt(x1,x2,7) 
x4 = 1 1 -1 -2 -1 1 1 


Hence 


za = (11,51, -2, -1,1,1) = zs(n) a 


In order to use the DFT for linear convolution, we must choose N properly. 
However, in practice it may not be possible to do so, especially when 
N is very large and there is a limit on memory. Then an error will be 
introduced when N is chosen less than the required value to perform the 
circular convolution. We want to compute this error, which is useful in 
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practice. Obviously, N > max(N;, N2). Therefore let 


max(Nj, N2) <N< (Ni +2- 1) 


Then from our previous analysis (5.44) 


oo 


aa(n) = | L z3(n — m| Rxy(n) 


r=-co 


Let an error e(n) be given by 


e(n) à z4(n) — za(n) 
= Y 2s(n — rN)| Ry(n) 
rz 


Since N > max(N;, N2), only two terms corresponding to r = +1 remain 
in the above summation. Hence 


e(n) = [rs(n - N) + z3(n + N) Ru (n) 


Generally, zı (n) and z2(n) are causal sequences. Then z3(n) is also causal, 
which means that 


z(n- N)20; O<n<N-1 
Therefore 
e(n) 2zs(n-- NR, 0OEnSN-1 (5.45) 


This is a simple yet important relation. It implies that when max(N;, N2) 
< N < (Ni + No — 1), the error sample at n is the same as the linear 
convolution N samples away. Now the linear convolution will be zero 
after (N1 + N2 — 1) samples. This means that the first few samples of the 
circular convolution are in error, while the remaining ones are the correct 
linear convolution values. 


Consider the sequences z1(n) and 22(n) from the previous example. Evaluate 
circular convolutions for N — 6, 5, and 4. Verify the error relations in each case. 


Clearly, the linear convolution zs(n) is still the same. 


zs(n) = {1,1,-1,—2,-1,1,1} 


When N = 6, we obtain a 6-point sequence. 


za(n) = 21(n) (8) 2a(n) = {2,1,-1,-2,-1,1} 


a A ———————————————u 
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Therefore 
e(n) = (2,1, -1, -2, 1,1) - (51, 71 -2,-11}, O<n<5 
= {1,0,0,0,0, 0} 
= za(n + 6) 


as expected. When N = 5, we obtain a 5-point sequence, 


a4(n) = 21(n) G) za(n) = {2,2,-1,-2, -1) 
and 
e(n) = {2,2,-1,-2,-1} - {1,1,-1,-2,-1}, OSns4 
= {1,1,0,0,0} 
= zs(n +5) 


Finally, when N = 4, we obtain a 4-point sequence, 


za(n) = x(n) (4) za(n) = {0, 2,0, -2} 
and 
e(n) = {0,2,0,-2}-{1,1,-1,-2}, 0€n&3 
= {-1,1,1,0} 
= za(n + 4) 


The last case of N = 4 also provides the useful observation given below. n 


Observation: When N = max(Ni, N2) is chosen for circular convolution, 
then the first (M — 1) samples are in error (i.e., different from the linear 
convolution), where M = min(N;, N2). This result is useful in implement- 
ing long convolutions in the form of block processing. 


When we want to filter an input sequence that is being received con- 
tinuously, such as a speech signal from a microphone, then for practical 
purposes we can think of this sequence as an infinite-length sequence. If 
we want to implement this filtering operation as an FIR filter in which 
the linear convolution is computed using the DFT, then we experience 
some practical problems. We will have to compute a large DFT, which is 
generally impractical. Furthermore, output samples are not available un- 
til all input samples are processed. This introduces an unacceptably large 
amount of delay. Therefore we have to segment the infinite-length input 
sequence into smaller sections (or blocks), process each section using the 
DFT, and finally assemble the output sequence from the outputs of each 


yes 22 mo VILE eue SS ae, 
Linear Convolution using the DFT . 157 





O EXAMPLE 5.18 


158 


section. This procedure is called a block convolution (or block processing) 
operation. 

Let us assume that the sequence z(n) is sectioned into N-point se- 
quences and that the impulse response of the filter is an M-point sequence, 
where M « N. Then from the above observation we note that the N-point 
circular convolution between the input block and the impulse response will 
yield a block output sequence in which the first (M — 1) samples are not 
the correct output values. If we simply partition x(n) into nonoverlapping 
sections, then the resulting output sequence will have intervals of incor- 
rect samples. To correct this problem, we can partition x(n) into sections, 
each overlapping with the previous one by exactly (M — 1) samples, save 
the last (N — M + 1) output samples, and finally concatenate these out- 
puts into a sequence. To correct for the first (M — 1) samples in the first 
output block, we set the first (M — 1) samples in the first input block to 


zero. This procedure is called an overlap-save method of block convolu-. 


tions. Clearly, when N >> M, this method is more efficient. We illustrate 

it using à simple example. É 

Let 2(n)=(n+1), 0 <n <9 and k(n) = (1,0, —1}. Implement the overlap- 
1 

save method using N = 6 to compute y(n) = z(n) * h(n). 

Since M = 3, we will have to overlap each section with the previous one by two 


samples. Now z(n) is a 10-point sequence, and we will need (M — 1) = 2 zeros 
in the beginning. Since N = 6, we will need 3 sections. Let the sections be 


z3(n) = {0,0, 1, 2,3, 4} 
z2(n) = {3,4,5, 6,7, 8} 
zs(n) = {7,8, 9, 10, 0,0} 
Note that we have to pad za(n) by two zeros since x(n) runs out of values at 


n = 9. Now we will compute the 6-point circular convolution of each section 
with A(n). 


yi = zi(n) (6) h(n) = {-3, ~4,1, 2,2, 2} 
y2 = 22(n) (8) h(n) = {—4,—4, 2, 2,2, 2} 
ys = za(n) (8) h(n) = {7,8, 2, 2, —9, -10} 


Noting that the first two samples are to be discarded, we assemble the output 
y(n) as 


y(n) = {1,2, 2, 2, 2, 2,2, 2,2, 2, —9, —10} 
1 
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The linear convolution is given by 


z(n) « h(n) = (1,2,2,2,2,2,2,2,2,2, —9, 10) 
T 


which agrees with the overlap-save method. oO 


Using the above example as a guide, we can develop a MATLAB function to 
implement the overlap-save method for a very long input sequence a(n). 
The key step in this function is to obtain a proper indexing for the seg- 
mentation. Given x(n) for n > 0, we have to set the first (M — 1) samples 
to zero to begin the block processing. Let this augmented sequence be 


^ 
£(n) —(0,0,...,0, 3 20 
(n) ={ z(n), n 
(M—1) zeros 


and let L = N — M +1, then the kth block z,(n, 0n € N-—1,is 
given by 


a(n) =8(m); kL<m<kL+N-1,k2>0,0Sn<N-1 


The total number of blocks is given by 


N,+M —2 
yea [MEM a 


where N, is the length of x(n) and |-| is the truncation operation. Now 
each block can be circularly convolved with h(n) using the circonvt 
function developed earlier to obtain 


yx(n) = zx(n) @) h(n) 


Finally, discarding the first (M — 1) samples from each y,(n) and con- 
catenating the remaining samples, we obtain the linear convolution y(n). 
This procedure is incorporated in the following ovrlpsav function. 


function [y] = ovripsav(x,h,N) 


* 


* 


Overlap-Save method of block convolution 
[y] = ovrlpsav(x,h,N) 

y = output sequence 

x = input sequence 

h = impulse response 

N = block length 


Lenx = length(x); M = length(h); 
Mi = M-1; L = N-M1; 
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[h zeros(1,N-M)]; 


x = [zeros(1,M1), x, zeros(1,N-1)]; X preappend (M-1) zeros 
K = floor((Lenx*M1-1)/(1)) ; % # of blocks 

Y = zeros(K+1,N); 

% convolution with succesive blocks 

for k=0:K 

xk = x(k*L+1:k*L+N); 

Y(k*1,:) = circonvt(xk,h,N); 


end 
Y = Y(:,M:N)’; i % discard the first (M-1) samples 
y= (YC))’; % assemble output 


It should be noted that the ovrlpsav function as developed here is not 
the most efficient approach. We will come back to this issue when we 
discuss the fast Fourier transform. 


Dj EXAMPLE 519 To verify the operation of the ovripsav function, let us consider the sequences 
given in Example 5.18. 


Solution MATLAB Script ———__————————— mm mm 
>> n = 0:9; x = ntl; h = [1,0,-1); N = 6; 
>> y = ovrlpsav(x,h,N) 
y = 
1 2 2 2 2 2 2 2 2 2 -9 -10 


a A ————— 


This is the correct linear convolution as expected. o 


There is an alternate method called an overlap-add method of block 
convolutions. In this method the input sequence z(n) is partitioned into 
nonoverlapping blocks and convolved with the impulse response. The re- 
sulting output blocks are overlapped with the subsequent sections and 
added to form the overall output. This is explored in Exercise 5.20. 


THE FAST FOURIER TRANSFORM 
rr] 


The DFT (5.24) introduced earlier is the only transform that is discrete in 
both the time and the frequency domains, and is defined for finite-duration 
sequences. Although it is a computable transform, the straightforward 
implementation of (5.24) is very inefficient, especially when the sequence 
length N is large. In 1965 Cooley and Tukey [4] showed a procedure to 
substantially reduce the amount of computations involved in the DFT. 
This led to the explosion of applications of the DFT, including in the 
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digital signal processing area. Furthermore, it also led to the development 
of other efficient algorithms. All these efficient algorithms are collectively 
known as fast Fourier transform (FFT) algorithms. 

Consider an N-point sequence x(n). Its N-point DFT is given by 
(5.24) and reproduced here 


N-1 
X(k) 3 a(n)wR*, O<SkSN-1 (5.46) 


n=0 


where Wy = e-3J?*/N. To obtain one sample of X(k), we need N complex 
multiplications and (N —1) complex additions. Hence to obtain a complete 
set of DFT coefficients, we need N? complex multiplications and N (N — 
1) = N? complex additions. Also one has to store N 2 complex coefficients 
{WRF} (or generate internally at an extra cost). Clearly, the number of 
DFT computations for an N-point sequence depends quadratically on N, 
which will be denoted by the notation 


Cn =0(N?) 


For large N, o (N?) is unacceptable in practice. Generally, the processing 
time for one addition is much less than that for one multiplication. Hence 
from now on we will concentrate on the number of complex multiplica- 
tions, which itself requires 4 real multiplications and 2 real additions. 


Goal of an Efficient Computation In an efficiently designed algo- 
rithm the number of computations should be constant per data sample, 
and therefore the total number of computations should be linear with 
respect to N. 

The quadratic dependence on N can be reduced by realizing that most 
of the computations (which are done again and again) can be eliminated 
using the periodicity property 


win = wie z w(rm» 
and the symmetry property 


knkN/2 _ kn 
wirtN? = wp 


of the factor (Wi). 

One algorithm that considers only the periodicity of Wh is the 
Goertzel algorithm. This algorithm still requires Cy = o(N' 2) multiplica- 
tions, but it has certain advantages. This algorithm is described in Chap- 
ter 10. We first begin with an example to illustrate the advantages of the 
symmetry and periodicity properties in reducing the number of compu- 
tations. We then describe and analyze two specific FFT algorithms that 
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require Cy = o(N log N) operations. They are the decimation-in-time 
(DIT-FFT) and decimation-in-frequency (DIF-FFT) algorithms. 


Let us discuss the computations of a 4-point DFT and develop an efficient 
algorithm for its computation. 


3 
X(k) =D a(n) Wi", OSkS3; W= e T Lj 


n=0 


The above computations can be done in the matrix form 


X(0) w? We We Wi] [«(0) 
xa) We Wi We Wa} 20) 


x| wa? we wi w| |z(2) 
(3) We Wi W$ Wil ix(3) 


which requires 16 complex multiplications. 


Efficient Approach: Using periodicity, 
W)-Wi-l ; Wi=We=-j 
We=Wh=-1 ; Wi-j 

and substituting in the above matrix form, we get 


xO] [p 1 1 17 F2(0) 
xa)| h -j -1 9) [2@ 
xQ| j| -i 1 -1| | 2(2) 
gl u j a -a Lee) 


Using symmetry, we obtain 


X(0)= 2(0)+2(1) +2(2)+2(3) = [z(0) + 2(2)] +[2(1) + x(3)] 


X(1) = 2(0) — jz(1) - z(2) + jz(3) = [e@) - 2(2)) -s[2() - z(3)] 
y =n 
X(2)= z(0)-2()-20)-2(3) = [z(0) + 2(2)] -[z(1) + 2(3)] 
1 — = 
2 92 
X(3) = 2(0) + jz(1) — z(2) — j2(3) = [2(0) - 2(2)) +z) - (3) 
hi ho 


oe 
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Hence an efficient algorithm is 


Step 1 Step 2 
gı = z(0) + z(2) X(0)= git+ge 
go = z(1) + z(3) X(1) = hi — jha (5.47) 


hy = 2(0) — 2(2) X(2)= gi - 92 
h2 = z(1) - z(3) X(3) =h + jha 


which requires only 2 complex multiplications, which is a considerably smaller 
number, even for this simple example. A signal flowgraph structure for this 
algorithm is given in Figure 5.18. 


An Interpretation: This efficient algorithm (5.47) can be interpreted differ- 
ently. First, a 4-point sequence z(n) is divided into two 2-point sequences, which 
are arranged into column vectors as given below. 


z(0) [z0)]] [zr(0 =(1) 
[o] Eol] E " an 
Second, a smaller 2-point DFT of each column is taken. 
w. z(0) z()] [1i i z(0) eu 
id Psi 5 l -1 o z(3) 
_ [s(0) + 2(2) d IS ga 
= |z(0-2(Q2) z()-2(3) lm hz 


Then each element of the resultant matrix is multiplied by (W1*), where p is 
the row index and q is the column index; that is, the following dot-product is 


performed: 
1 1 aJn Pj- gı 92 
1 -j h hà hı —jha 





FIGURE 5.18 Signal flowgraph in Example 5.20 
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Finally, two more smaller 2-point DFTs are taken of row vectors. 


fe p|w s sl f ae 9-9 
hi jha] ° [M —gha] i [jh fa + jhe 
[x() xq) 
i pen iul 


Although this interpretation seems to have more multiplications than the effi- 
cient algorithm, it does suggest a systematic approach of computing a larger 
DFT based on smaller DFTs. o 








DIVIDE-AND- To reduce the DFT computation’s quadratic dependence on N, one must 
COMBINE choose a composite number N = LM since 
APPROACH 
I? + M? « N? for large N 
Now divide the sequence into M smaller sequences of length L, take M 
smaller L-point DFTs, and then combine these into a larger DFT using 
L smaller M-point DFTs. This is the essence of the divide-and-combine 
approach. Let N = LM, then the indices n and k in (5.46) can be written 
as 
n= Mé+m, O0<€<L-1, 0<m<M-1 5.48 
k=ptlq, O<Sp<L-1, 0<qsM-1 M 
and write sequences z(n) and X(k) as arrays z(£, m) and X (p, q), respec- 
tively. Then (5.46) can be written as 
M-i L-1 
X(p, a) = X > z(£, m)W(M'*mXerLo (5.49) 
m=0 &=0 
M-1 L-1 
- nr [Seeme] wt 
m=0 é=0 
M-1 L-1 
= Wy? X tne wre 
m=0 é=0 
L-point DFT 
M-point DFT 
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Hence (5.49) can be implemented as a three-step procedure: 


1. First, we compute the L-point DFT array 


L-1 
F(p,m) = D> z(£, mWP; O0<p<L-1 (5.50) 
£-0 


for each of the columns m = 0,..., M — 1. 
2. Second, we modify F(p, m) to obtain another array. 


O<p<L-1 
-2WwPF ; p 51 
G(p,m) N (p,m) 0<m<M-1 (5 ) 
The factor WE" is called a twiddle factor. 
3. Finally, we compute the M-point DFTs 
M-1 
X(p.a)= 3; G(p,mWy* OSaSM—1 (5.52) 


m=0 
for each of the rows p= 0,...,L— 1. 


The total number of complex multiplications for this approach can now 
be given by 


Cn = ML? & N & LM? « o(N?) (5.53) 


'This procedure can be further repeated if M or L are composite num- 
bers. Clearly, the most efficient, algorithm is obtained when N is a highly 
composite number, that is, N = R”. Such algorithms are called radiz-R 
FFT algorithms. When N = RY R? ++, then such decompositions are 
called mized-radiz FFT algorithms. The one most popular and easily pro- 
grammable algorithm is the radix-2 FFT algorithm. 


Let N — 2"; then we choose M — 2 and L — N/2 and divide z(n) into 
two N/2-point sequences according to (5.48) as 


gi(n) = 2(2n) 


gln) = z(2n +1) ? 


lA 


ns 


wx 


-1 


The sequence g1(n) contains even-ordered samples of z(n), while go(n) 
contains odd-ordered samples of z(n). Let G1 (k) and G2(k) be N/2-point 
DFTs of gi (n) and go(n), respectively. Then (5.49) reduces to 


X(k) 2 Gi(k) +WyGo(k), OSESN-1 (5.54) 
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This is called a merging formula, which combines two N/2-point DFTs 
into one N-point DFT. The total number of complex multiplications re- 
duces to 


N? 
CN = V +N =0(N?/2) 


This procedure can be repeated again and again. At each stage the se- 
quences are decimated and the smaller DFTs combined. This decimation 
ends after v stages when we have N one-point sequences, which are also 
one-point DFTs. The resulting procedure is called the decimation-in-time 
FFT (DIT-FFT) algorithm, for which the total number of complex mul- 
tiplications is 


Cy = Nv = N log N 


Clearly, if N is large, then Cy is approximately linear in N, which was 
the goal of our efficient algorithm. Using additional symmetries, Cy can 
be reduced to ¥ log, N. The signal flowgraph for this algorithm is shown 
in Figure 5.19 for N = 8. 





FIGURE 5.19 Decimation-in-time FFT structure for N = 8 
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In an alternate approach we choose L = 2, M = N/2 and follow 
the steps in (5.49). Note that the initial DFTs are 2-point DFTs, which 
contain no complex multiplications. From (5.50) 


F(0,m) = z(0, m) + 2(1,m)W3 
= z(n) + s(n + N/2), 0 < n < N/2 
F(1,m) = 2(0,m) + z(1,m)W3 
= z(n) — z(n + N/2), 0 < n < N/2 
and from (5.51) 
G(0,m) = F(0,m)W8 
= z(n) + z(n + N/2), 0 < n < N/2 
G(1,m) = F(1,m)WẸ 
= [z(n) - z(n + N/2) WẸ, 0 € n < N/2 


(5.55) 


Let G(0, m) = di(n) and G(1,m) = d2(n) for 0 < n < N/2—1 (since 
they can be considered as time-domain sequences); then from (5.52) we 
have 


X(0,q)= X(2q) = D(a) 


(5.56) 
X(1,q) = X(2q + 1) = Da(q) 
This implies that the DFT values X(k) are computed in a decimated 
fashion. Therefore this approach is called a decimation-in-frequency FFT 
(DIF-FFT) algorithm. Its signal flowgraph is a transposed structure of 
the DIT-FFT structure, and its computational complexity is also equal 
to x log; N. 


MATLAB provides a function called fft to compute the DFT of a vector x. 
It is invoked by X = fft(x,N), which computes the N-point DFT. If the 
length of x is less than N, then x is padded with zeros. If the argument N 
is omitted, then the length of the DFT is the length of x. If x isa matrix, 
then fft(x,N) computes the N-point DFT of each column of x. 

This £ft function is written in machine language and not using MAT- 
LAB commands (i.e., it is not available as a .m file). Therefore it executes 
very fast. It is written as a mixed-radix algorithm. If N is a power of 
two, then a high-speed radix-2 FFT algorithm is employed. If N is not 
a power of two, then N is decomposed into prime factors and a slower 
mixed-radix FFT algorithm is used. Finally, if N is a prime number, then 
the fft function is reduced to the raw DFT algorithm. 


I — 
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The inverse DFT is computed using the i£ft function, which has the 
same characteristics as fft. 


In this example we will study the execution time of the fft function for 1 € 
N « 2048. This will reveal the divide-and-combine strategy for various values 
of N. 


To determine the execution time, MATLAB provides two functions. The clock 
function provides the instantaneous clock reading, while the etime(t1,t2) func- 
tion computes the elapsed time between two time marks t1 and t2. To determine 
the execution time, we will generate random vectors from length 1 through 2048, 
compute their FFTs, and save the computation time in an array. Finally, we 
will plot this execution time versus N. 


MATLAB Script. LL —————————————————— — 
>> Nmax = 2048; 

>> fft_time=zeros(1,Nmax) ; 

>> for n=1:1:Nmax 

>>  xerand(1,n); 

>> t=clock;fft (x) ;£ft_time(n)=etime(clock,t) ; 
>> end 

>> n=(1:1:Nmax] ; 

>> plot(n,fft_time,’.’) 

>> xlabel(’N’);ylabel(’Time in Sec.’) 

>> title(’FFT execution times’) 


a e a re 


The plot of the execution times is shown in Figure 5.20. This plot is very in- 
formative. The points in the plot do not show one clear function but appear 
to group themselves into various trends. The uppermost group depicts a o(N?) 
dependence on N, which means that these values must be prime numbers be- 
tween 1 and 2048 for which the FFT algorithm defaults to the DFT algorithm. 
Similarly, there are groups corresponding to the o (N 27 2), o (N 27 3), o (N ay 4), 
and so on, dependencies for which the number N has fewer decompositions. 
The last group shows the (almost linear) o (N log N) dependence, which is for 
N =2,0 € v € 11. For these values of N, the radix-2 FFT algorithm is used. 
For all other values, a mixed-radix FFT algorithm is employed. This shows that 
the divide-and-combine strategy is very effective when N is highly composite. 
For example, the execution time is 0.16 second for N — 2048, 2.48 seconds for 
N = 2047, and 46.96 seconds for N = 2039. n 


The MATLAB functions developed previously in this chapter should 
now be modified by substituting the fft function in place of the dft 
function. From the above example care must be taken to use a highly 
composite N. À good practice is to choose N = 2" unless a specific 
situation demands otherwise. 


ee 
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FIGURE 5.20 FFT execution times for 1 <= N <= 2048 


The conv function in MATLAB is implemented using the filter function 
(which is written in C) and is very efficient for smaller values of N (« 50). 
For larger values of N it is possible to speed up the convolution using the 
FFT algorithm. This approach uses the circular convolution to implement 
the linear convolution, and the FFT to implement the circular convolu- 
tion. The resulting algorithm is called a fast convolution algorithm. In 
addition, if we choose N = 2" and implement the radix-2 FFT, then the 
algorithm is called a high-speed convolution. Let x; (n) be a Ni-point se- 
quence and zz (n) be a N2-point sequence; then for high-speed convolution 
N is chosen to be 


N = qlloga(NitNa~1)1 (5.57) 


where [x] is the smallest integer greater than z (also called a ceiling 
function). The linear convolution z (n) * £2 (n) can now be implemented 
by two N-point FFTs, one N-point IFFT, and one N-point dot-product. 


z; (n) * zo (n) = IFFT [FFT |z: (n)] - FFT [z2 (n)]] (5.58) 


For large values of N, (5.58) is faster than the time-domain convolution 
as we see in the following example. 
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O EXAMPLE 5.22 


Solution 


HIGH-SPEED 
BLOCK CON- 
VOLUTIONS 





To demonstrate the effectiveness of the high-speed convolution, let us compare 
the execution times of two approaches. Let z;(n) be an L-point uniformly 
distributed random number between (0, 1], and let x2 (n) be an L-point Gaussian 
random sequence with mean 0 and variance 1. We will determine the average 
execution times for 1 < L < 150, in which the average is computed over the 100 
realizations of random sequences. 


MATLAB Script 
cony time = zeros(1,150); fft time = zeros(1,150); 


* 
for L = 1:150 
tc = 0; tf=0; 
N = 2#L-1; nu = ceil(logi0(NI1)/1og10(2)); N = 2^mu; 
for I=1:100 
h = randn(1,L); 
x = rand(1,L); 
t0 = clock; yi = conv(h,x); ti=etime(clock,t0) ; 
tc = tetti; 
tO = clock; y2 = ifft(fft(h,N).*fft(x,N)); t2-etime(clock,tO); 
tf = tf4t2; 
end 
* 
conv, time(L)-tc/100; 
fft time(L)-tf/100; 
end 
4 


n = 1:150; subplot(1,1,1); 
plot (n(25:150) ,conv_time(25:150) ,n(25: 150) ,£ft time(25:150)) 


Figure 5.21 shows the linear convolution and the high-speed convolution times 
for 25 < L < 150. It should be noted that these times are affected by the 
computing platform used to execute the MATLAB script. The plot in Figure 
5.21 was obtained on a 33-MHz 486 computer. It shows that for low values of 
L the linear convolution is faster. The crossover point appears to be L — 50, 
beyond which the linear convolution time increases exponentially, while the 
high-speed convolution time increases fairly linearly. Note that since N — 2", 
the high-speed convolution time is constant over a range on L. o 


Earlier we discussed a block convolution algorithm called the overlap-and- 
save method (and its companion the overlap-and-add method), which is 
used to convolve a very large sequence with a relatively smaller sequence. 
The MATLAB function ovrlpsav developed in that section uses the DFT 
to implement the linear convolution. We can now replace the DFT by 
the radix-2 FFT algorithm to obtain a high-speed overlap-and-save algo- 
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Comparison of convolution times 
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FIGURE 5.21 Comparison of linear and high-speed convolution times 


rithm. To further reduce the computations, the FFT of the shorter (fixed) 
sequence can be computed only once. The following hsolpsav function 
shows this algorithm. 


function [y] = hsolpsav(x,h,N) 
% High-speed Overlap-Save method of block convolutions using FFT 


X [y] = hsolpsav(x,h,N) 

% y = output sequence 

% x = input sequence 

% h = impulse response 

% N = block length (must be a power of two) 
* 

N = 2^(ceil(1ogi10(N)/1og10(2)); 

Lenx = length(x); M = length(h); 

Mi = M-1; L = N-M1; 

h = fft(h,N); 


h 

x = [zeros(1,M1), x, zeros(1,N-1)]; 

K = floor((Lenx:Mi-1)/(L)); 4 # of blocks 
Y = zeros(K+1,N); 
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for k=0:K 

xk = fft(x(k*L+1:k*L+N)); 
Y(k+1,:) = real(ifft(xk.*h)); 
end 

Y= YG,MD; y = YC)’; 


A similar modification can be done to the overlap-and-add algorithm. 


PROBLEMS 


P5.1 


P5.2 


P5.3 


Determine the DFS coefficients of the following periodic sequences using the DFS definition, 
and verify by using MATLAB. 


a. žı (n) = {2,0,2,0}, N= 4 

b. ž2(n) = {0,0, 1,0,0}, N — 5 

c. ža (n) = {3,-3,3, -3}, N =4 

d. ža (n) = {hj -i 3 N= 4 

e. s(n) - (55,51, N=4 

Determine the periodic sequences, given the following periodic DFS coefficients. First use 
the IDFS definition and then verify using MATLAB. 


a. X1(k) = {5,-23,3, 2j}, N =4 

b. Xa (k) = {4,-5,3, -5}, N = 4 

c. X3(k) = {1,2,3,4,5}, N =5 

d. X4(k) = {0,0,2,0}, N=4 

e. Xs(k) = (0,3, 25, -3}, N=4 

Let %1(n) be periodic with fundamental period N — 50, where one period is given by 


E ne", O<n<25 
&(n)-7l ,  o»5«n«49 


and let £2(n) be periodic with fundamental period N — 100, where one period is given by 


2 ne 9^, 0<n<25 
$0-1 o  »5«n«o 


These two periodic sequences differ in their periodicity but otherwise have equal nonzero 
samples. 


a. Find the DFS X, (k) of žı(n) and plot samples (using the stem function) of its 
magnitude and angle versus k. 


b. Find the DFS X (k) of Z2(n) and plot samples of its magnitude and angle versus k. 
c. What is the difference between the above two DFS plots? 
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P5.4 


P5.5 


P5.6 





Consider the periodic sequence Z;(n) given in Problem 5.3. Let %3(n) be periodic with 
period 100, obtained by concatenating two periods of z1(n), that is, 
3(n) = [ži (n), z1(n)lpgniopic 


Clearly, Zs(n) is different from ž2(n) of Problem 3 even though both of them are periodic 
with period 100. 

a. Find the DFS Xs (k) of Z3(n) and plot samples of its magnitude and angle versus k. 
b. What effect does the periodicity doubling have on the DFS? 

c. Generalize the above result to M-fold periodicity. In particular, show that if 


£u (n) = | i(n),..., zi(n) 
——— 
M times PERIODIC 


then 


Xu (Mk) =MXi(k), k20,L..., N-1 


Xm (k) = 0, k Z0,M,..., MN 
Let X(e/") be the DTFT of a 10-point sequence: 

z (n) = (2,5,3, —4, -2,6,0, —3, 3,2) 
a. Let 


i (n) =IDFS [X (e9), x (e), xx e*7/*)] 


Determine y: (n) using the frequency sampling theorem. Verify your answer using MATLAB. 
b. Let 


2 int 5 s I x x 
ya (n) = IDES. [X (e), X (e?7/79), x (e)... x (e709) 


Determine y» (n) using the frequency sampling theorem. Verify your answer using MATLAB. 
A 12-point sequence is x(n) defined as 


z (n) = (1,2,3,4,5,6,6,5,4,3,2,1) 


a. Determine the DFT X (k) of z (n). Plot (using the stem function) its magnitude and 
phase. 

b. Plot the magnitude and phase of the DTFT X (e^) of x(n) using MATLAB. 

c. Verify that the above DFT is the sampled version of X (e/"). It might be helpful to 
combine the above two plots in one graph using the hold function. 


d. Is it possible to reconstruct the DTFT X(e") from the DFT X (k)? If possible, give the 
necessary interpolation formula for reconstruction. If not possible, state why this 
reconstruction cannot be done. 


P5.7 


P5.8 


P5.9 


Plot the DTFT magnitudes of the following sequences using the DFT as a computation 
tool. Make an educated guess about the length N so that your plots are meaningful. 


a. zı (n) = 2cos (0.271) [u (n) — u (n — 10)] 

b. x2 (n) = sin(0.457n)sin(0.55mn), OSn <50 

c. z3 (n) =3(2)", ~10<n<10 

d. z4 (n) =(-0.5)", -10<n <10 

e. z5 (n)=5 (0.96/7/*)" u(n) 

Let H(e”) be the frequency response of a real, causal discrete-time LTI system. 
a. If 


Re {H (e”)} = V. (0.5)* cos (kw) 


k=0 


determine the impulse response h (n) analytically. Verify your answer using IDFT as a 
computation tool. Choose the length N judiciously. 


b. If 


5 
Im {H (e)} = So resin (lw) and 


à H(e")d» =0 
t=0 =F 


determine the impulse response h (n) analytically. Verify your answer using IDFT as a 
computation tool. Again choose the length N judiciously. 


Let X (k) denote the N-point DFT of an N-point sequence z (n). The DFT X (k) itself is 
an N-point sequence. 


a. If the DFT of X (k) is computed to obtain another N: -point sequence 2 (n), show that 
m(neNz(m)y, OSNSN-1 


b. Using the above property, design a MATLAB function to implement an N-point circular 
folding operation za (n) = zi ((—n)) y. The format should be 


x2 = circfold(xi,N) 

4 Circular folding using DFT 

% x2 = circfold(x1,N) 

% x2 = circularly folded output sequence 
% xi = input sequence of length <= N 

% N= circular buffer length 


c. Determine the circular folding of the following sequence: 


zı (n) = (1,2,3,4,5,6,6,5,4,3,2,1) 
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P5.10 


P5.11 


P5.12 





Complex-valued N-point sequences are decomposed into N-point even and odd sequences 
using the following relations: 


[z (0) + 2° ((-n))y] 


[z (n) - z* ((-7))x] 

Then 
DFT [zec (n)] = Re [X(k)] = Re [X ((-k)) w] 
DPT [zoc (n)] = j Im [X (&) = j 1m [X (-5))4] 


a. Prove the above property analytically. 


b. Modify the circevod function developed in the chapter so that it can be used for 
complex-valued sequences. 


c. Verify the above symmetry property and your MATLAB function on the following 
sequence. 


z (n) = (0.9e"/*)" fu (n) — u (n — 20)] 
The first five values of the 8-point DFT of a real-valued sequence x (n) are given by 
(0.25,0.125 — j0.3,0,0.125 — j0.06,0.5) 
Determine the DFT of each of the following sequences using properties. 
a. zy (n) = z ((2 — ))s 
b. za (n) = 2((n+5))i9 
c. 23 (n) = z? (n) 
d. za (n) = 2 (n) (8) (79). 
e. zs (n) = x(n) ei*n/4 
If X (k) is the DFT of an N-point complex-valued sequence 
a(n) = zn (n) + jar (n) 
where zp (n) and zy (n) are the real and imaginary parts of z (n), then 
Xn (k) Ê DFT [za (n)] = Xec (k) 
4X1 (k) Ê DFT [21 (0) = Xoe (k) 


where Xec (k) and Xoc (k) are the circular-even and circular-odd components of X (k) as 
defined in Problem 5.10. 
a. Prove the above property analytically. 


b. This property can be used to compute the DFTs of two real-valued N-point sequences 
using one N-point DFT operation. Specifically, let xı (n) and x2 (n) be two N-point 
sequences. Then we can form a complex-valued sequence 


z (n) = 21 (n) + jz2 (n) 
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P5.13 





and use the above property. Develop a MATLAB function to implement this approach with 
the following format. 


function [X1,X2] = real2dft(x1,x2,N) 
% DFTs of two real sequences 

% [X1,12) = real2dft(x1,x2,N) 

% Xi = n-point DFT of x1 

% X2 = n-point DFT of x2 

% xi * sequence of length <= N 

% x2 = sequence of length <= N 

X N = length of DFT 


c. Compute the DFTs of the following two sequences: 
z (n) = cos (0.255) , z (n) = sin (0.7577); OSn< 63 


Using the frequency-domain approach, develop a MATLAB function to determine a circular 
shift z ((n — m))y, given an N;-point sequence a(n), where N, < N. Your function should 
have the following format. 


function y * cirshftf(x,m,N) 
* 
Xfunction yzcirshftf(x,m,N) 


% Circular shift of m samples wrt size N in sequence x: (freq domain) 


y : output sequence containing the circular shift 
x : input sequence of length <= N 
* m : sample shift 
N : size of circular buffer 
€ Method: y(n) = idft(dft(x(n))*WN^ (nk)) 
y 
[A 
% If m is a scalar then y is a sequence (row vector) 
4% If m is a vector then y is a matrix, each row is a circular shift 


% in x correspondi to entries in vecor m 
ponding 
% M and x should not be matrices 


Verify your function on the following sequence 
zi(n)211-n, O¢n<10 


with m = 10 and N = 15. 


P5.14 Using the analysis and synthesis equations of the DFT, show that 


N 


N-1 -1 
Y ise? - x Y X (f 
k=0 


n=0 
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P5.15 


P5.16 


P5.17 


P5.18 


P5.19 


This is commonly referred to as a Parseval's relation for the DFT. Verify this relation by 
using MATLAB on the sequence in Problem 5.9. 


Using the frequency domain approach, develop a MATLAB function to implement the 
circular convolution operation between two sequences. The format of the sequence should be 


function x3 = circonvf(x1,x2,N) 

% Circular convolution in the frequency domain 
% x3 = circonvf(x1,x2,N) 

X4 x3 = convolution result of length N 

% xi = sequence of length <= N 

% x2 = sequence of length <= N 

% N= length of circular buffer 


The circonvt function developed in this chapter implements the circular convolution as a 
matrix-vector multiplication. The matrix corresponding to the circular shifts 

{x ((n—m))y; O<n<N—1y hasan interesting structure. This matrix is called a 
circulant matrix, which is a special case of the Toeplitz matrix introduced in Chapter 2. 
a. Consider the sequences given in Example 5.13. Express zi (n) as a column vector x, and 
z2 ((n — m))y as a matrix X2 with rows corresponding to n = 0, 1, 2, 3. Characterize this 
matrix X2. Can it completely be described by its first row (or column)? 

b. Determine the circular convolution as X2x: and verify your calculations. 

Develop a MATLAB function to construct a circulant matrix C, given an N-point sequence 
z (n). Use the cirshftf function developed in Problem 5.13. Your subroutine function 
should have the following format. 


function [C] = circulnt(x,N) 

% Circulant Matrix from an N-point sequence 
¥% (C] = circulnt(x,N) 

X C = circulant matrix of size NxN 

% x = sequence of length <= N 

% N = size of circulant matrix 


Using this function, modify the circular convolution function circonvt discussed in the 
chapter so that the for. ..end loop is eliminated. Verify your functions on the sequences in 
Problem 5.16. 


Compute the N-point circular convolution for the following sequences. 

a. zi (n) = {1,1,1,1}, z2 (n) = cos(mn/4) Rn (n); N=8 

b. zi (n) = cos (2:n/N) Rn (n), 22 (n) 2sin(2zn/N) Ru (n; N—32 

c. m (n) = (0.8)" Ry (n), z2 (n) = (-0.8" Ru (n); N20 

d. zi (n) = nRx (n), z2(n) = (N - n) Rv (n); N=10 

e. zı (n) = {1,-1,1,-1}, z2 (n) = {1,0,-1,0}; N=4 

For the following sequences compute (i) the N-point circular convolution zs (n) = 21 (n) 


@) 2 (n), (ii) the linear convolution z4 (n) = 21 (n) + z2 (n), and (iii) the error sequence 
e(n) = za (n) — za (n). 
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. m(n) = {1,1,1,1}, z2(n) = cos(sn/4)Roe(n; N=8 

. zı (n) = cos (20n/N) Rae (n), zz (n) = sin {(2rn/N) Rais (n; N32 
. zi (n) = (0.8)" Rio (n), z2 (n) = (-0.8)" Rio (n); N — 15 

. zi (n) = nRao (n), z2 (n) = (N — n) Rio (n); N=10 

. z (n) = {1,-1,1,-1}, 22 (n) = {1,0,-1,0}; N=5 

In each case verify that e(n) = za (n + N). 


ona fo c $9 


P5.20 The overlap-add method of block convolution is an alternative to the overlap-save method. 
Let z (n) be a long sequence of length ML, where M,L > 1. Divide z (n) into M segments 
[zw (n), m 2 1,..., M}, each of length L. 


a(n), mM <n<(m+1)M-1 = 
Im (n) = t OUR so that a(n)= p» Im (n) 


Let h (n) be an L-point impulse response; then 


M-1 M-i 
y(n) =2(n)#h(n) = Ý zu (n)*h(n)= > ymn); Ym (0) È am (0) +h (n) 


m=0 m=0 


Clearly, ym (n) is a (2L — 1)-point sequence. In this method we have to save the 
intermediate convolution results and then properly overlap these before adding to form the 
final result y (n). To use DFT for this operation, we have to choose N > (2L — 1). 

a. Develop a MATLAB function to implement the overlap-add method using the circular 
convolution operation. The format should be 


function [y] = ovrlpadd(x,h,N) 

% Overlap-Add method of block convolution 
X Ly] = ovrlpadd(x,h,N) 

x 

% y = output sequence 

% x = input sequence 

X h = impulse response 

% N = block length >= 2*length(h)-1 


b. Incorporate the radix-2 FFT implementation in the above function to obtain a 
high-speed overlap-add block convolution routine. Remember to choose N = 2”. 


c. Verify your functions on the following two sequences: 
z (n) = cos (mn /500) Raooo(n), h(n) = {1,-1,1,-1} 
P5.21 Given the sequences z; (n) and 22 (n) shown below: 
zı (n) = {2,1,1,2}, 22 (n) = {1,-1,-1,1} 


a. Compute the circular convolution zi (n) (N) z2 (n) for N — 4, 7, and 8. 


b. Compute the linear convolution zi (n) * z2 (n). 
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c. Using results of calculations, determine the minimum value of N necessary so that linear 
and circular convolutions are the same on the N-point interval. 


d. Without performing the actual convolutions, explain how you could have obtained the 
result of part c. 


P5.22 Let 


a(n) = orn OSnEN-l, A cos (antn/N) Ru (n) 


0, elsewhere 
where £ is an integer. Notice that z (n) contains ezactly £ periods (or cycles) of the cosine 
waveform in N samples. This is a windowed cosine sequence containing no leakage. 

a. Show that the DFT X (k) is a real sequence given by 


AN 
x(k) = Zee - + Noe - N +0); O<k<(N-1),0<¢<N 
b. Show that if £ — 0, then the DFT X (k) is given by 
X(k) = AN6 (X); O€ks(N-1) 


c. Explain clearly how the above results should be modified if £ « 0 or L£>N. 


d. Verify the results of parts a, b, and c by using the following sequences. Plot the real 
parts of the DFT sequences using the stem function. 


(i) zı (n) = 3cos (0.04) R200 (n) 
(ii) x2 (n) = 5Rs0 (n) 
(ii) za (n) = [1 + 2cos (0.57n) + cos (1n)] Roo (n) 
(iv) z4 (n) = cos (2511/16) Rea (n) 
(v) zs (n) = [4cos (0.1rn) — 3cos (1.9mn)] Rn (n) 
P5.23 Let x(n) = Acos (won) Rn (n), where wo is a real number. 
a. Using the properties of the DFT, show that the real and the imaginary parts of X (k) 
are given by 


X (k) = Xn (k) + 3X1 (k) 


2 T(N-1), _ sin [x (k — foN)] 
Xn (k) = (A/2) cos | N (k f) sin [x (k- RN) /N] 


"(N -—1) sin [r (k — N + foN)] 
+ (4/2) cos Ea Gf) abe- +N) INI AN) INi 
n(N —1) 


X: (k) = — (4/2) sin [rn (k- f) n AAT 


P _ | a(N ~—1) sin [r (k — N + foN)] 
(4/2)sn | N (f) Safe (k N+ AN) /N] 


b. The above result implies that the original frequency wo of the cosine waveform has leaked 
into other frequencies that form the harmonics of the time-limited sequence, and hence it is 
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called the leakage property of cosines. It is a natural result due to the fact that 
band-limited periodic cosines are sampled over noninteger periods. Explain this result using 
the periodic extension £(n) of z (n) and the result in Problem 5.22 part a. 


c. Verify the leakage property using z (n) = cos (57/99) R200 (n). Plot the real and the 
imaginary parts of X (k) using the stem function. 


P5.24 Let 


z(n)= dd dici Asin (2rén/N) Rx (n) 


0, elsewhere 
where £ is an integer. Notice that x (n) contains exactly £ periods (or cycles) of the sine 
waveform in N samples. This is a windowed sine sequence containing no leakage. 


a. Show that the DFT X (k) is a purely imaginary sequence given by 
x(t) = A -- 55 - N 0: 0€kz(N-1,0«t«N 


b. Show that if £ = 0, then the DFT X (k) is given by 
X(k)=0; O<k<(N-1) 


c. Explain clearly how the above results should be modified if £ < 0 or £ > N. 


d. Verify the results of parts a, b, and c using the following sequences. Plot the imaginary 
parts of the DFT sequences using the stem function. 


(i) a1 (n) = 3sin (0.040) Roo (n) 
(ii) a2 (n) = 5sin 10rnRso (n) 
(üi) za (n) = [2sin (0.5mn) + sin (xn)] Rioo (n) 
(iv) za (n) = sin (2571/16) Ra (n) 
(v) zs (n) = [4sin (0.1) — 3sin (1.97n)] Rw (n) 
P5.25 Let x(n) = Asin (won) Rn (n), where wo is a real number. 
a. Using the properties of the DFT, show that the real and the imaginary parts of X (k) 
are given by 
X (k) = Xr (k) + 5X1 (k) 
sin [r (k — foN)] 
sin (x (k — foN) /N] 
sin [r (k — N + foN)] 
sin [r (k — N + foN) /N] 
sin [r (k — foN)] 
infr ( — foN) /N] 
sin [r (k — N + foN)] 
sin [r (k — N + foN) /N] 





T(N— 
N 


Xn (E) = (A/2) sin | 1) k- fe) 


— (A/2) sin Ea (k+ v) 


Xi (K) =- (4/2) es Ee» t- f) 





+ (A/2) cos Ea (k+ v) 
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b. The above result is the leakage property of sines. Explain it using the periodic extension 
£(n) of x(n) and the result in Problem 5.24 part a. 
c. Verify the leakage property using x (n) = sin (571/99) Rao (n). Plot the real and the 
imaginary parts of X (k) using the stem function. 
P5.26 An analog signal £a(t) = 2sin (47t) + 5cos (87t) is sampled at t = 0.01n for 
n 20,1,..., N — 1 to obtain an N-point sequence z (n). An N-point DFT is used to obtain 
an estimate of the magnitude spectrum of ze (t). 
a. From the following values of N, choose the one that will provide the accurate estimate of 
the spectrum of za(t). Plot the real and imaginary parts of the DFT spectrum |X (&)]. 
(i) N = 40, (ii) N = 50, (iii) N = 60. 
b. From the following values of N, choose the one that will provide the least amount of 
leakage in the spectrum of za (t). Plot the real and imaginary parts of the DFT spectrum 
IX (k)|- 
(i) N = 90, (ii) N = 95, (iii) N = 99. 
P5.27 Using (5.49), determine and draw the signal flowgraph for the N = 8 point, radix-2 
decimation-in-frequency FFT algorithm. Using this flowgraph, determine the DFT of the 
sequence 


x(n) =cos(mn/2), O<n<7 


P5.28 Using (5.49), determine and draw the signal flowgraph for the N = 16-point, radix-4 
decimation-in-time FFT algorithm. Using this flowgraph, determine the DFT of the 
sequence 


a(n) =cos(mn/2), OSn<15 


P5.29 Let x(n) = cos(nh/99), 0<n< (N — 1) be an N-point sequence. Choose N = 4” and 


determine the execution times in MATLAB for v = 5,6,...,10. Verify that these times are 
proportional to 
Nlog,N 
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DIGITAL FILTER 
STRUCTURES 


In earlier chapters we studied the theory of discrete systems in both the 
time and frequency domains. We will now use this theory for the process- 
ing of digital signals. To process signals, we have to design and implement 
systems called filters (or spectruni analyzers in some contexts). The filter 
design issue is influenced by such factors as the type of the filter (i.e., IIR 
or FIR) or the form of its implemehtation (structures). Hence before we 
discuss the design issue, we first concern ourselves with how these filters 
can be implemented in practice. This is an important concern because 
different filter structures dictate different design strategies. 

As we discussed earlier, IIR. filters are characterized by infinite- 
duration impulse responses. Some of these impulse responses can be 
modeled by rational system functions or, equivalently, by difference equa- 
tions. Such filters are termed as auto-regressive moving average (ARMA) 
or, more generally, as recursive filters. Those IIR filters that cannot be so 
modeled are called nonrecursive filters. In DSP, IIR filters generally imply 
recursive ones because these can be implemented efficiently. Therefore 
we will always use the term IIR to imply recursive filters. Furthermore, 
ARMA filters include moving average filters that are FIR filters. However, 
we will treat FIR filters separately from IIR filters for both design and 
implementation purposes. 

We begin with a description of basic building blocks that are used 
to describe filter structures. In the remaining sections we briefly describe 
IIR, FIR, and lattice filter structures, respectively, and provide MATLAB 
functions to implement these structures. 


BASIC ELEMENTS 


Since our filters are LTI systems, we need the following three elements to 
describe digital filter structures. These elements are shown in Figure 6.1. 


e Adder: This element has two inputs and one output and is shown 
in Figure 6.1(a). Note that the addition of three or more signals is imple- 
mented by successive two-input adders. 

e Multiplier (gain): This is a single-input, single-output element and 
is shown in Figure 6.1(b). Note that the multiplication by 1 is understood 
and hence not explicitly shown. 

e Delay element (shifter or memory): This element delays the signal 
passing through it by one sample as shown in Figure 6.1(c). It is imple- 
mented by using a shift register. 


Using these basic elements, we can now describe various structures of 
both IIR and FIR filters. MATLAB is a convenient tool in the development 
of these structures that require operations on polynomials. 


IIR FILTER STRUCTURES 


The system function of an IIR. filter is given by 


M 
L bz -1 -M 
B(z) anco bo + biz | +--+ +bmz 
Hi) A(z) $ m Ltayz-) +--+ +anz-N Es (6.1) 
n 
n=0 


where b, and an are the coefficients of the filter. We have assumed without 
loss of generality that ao = 1. The order of such an IIR filter is called N if 


xin) p RD + x(n) 
xin) (a) Adder 


a 2 
xin) e———— ——* ax(n) xin) €—— 9————* x(n - 1) 
(b) Multiptier (c) Delay element 


FIGURE 6.1 Three basic elements 
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DIRECT FORM 





an 7. 0. The difference equation representation of an IIR filter is expressed 
as 


M N 
y(n) = Y b, z(n—m)- X amy(n — m) (6.2) 


m=0 


' Three different structures can be used to implement an IIR filter: 


e Direct form: In this form the difference equation (6.2) is imple- 
mented directly as given. There are two parts to this filter, namely the 
moving average part and the recursive part (or equivalently, the numera- 
tor and denominator parts). Therefore this implementation leads to two 
versions: direct form I and direct form II structures. 

e Cascade form: In this form the system function H(z) in equation 
(6.1) is factored into smaller second-order sections, called biquads. The 
system function is then represented as a product of these biquads. Each 
biquad is implemented in a direct form, and the entire system function is 
implemented as a cascade of biquad sections. 

e Parallel form: This is similar to the cascade form, but after factor- 
ization, a partial fraction expansion is used to represent H(z) as a sum 
of smaller second-order sections. Each section is again implemented in a 
direct form, and the entire system function is implemented as a parallel 
network of sections. 


We will briefly discuss these forms in this section. IIR filters are gen- 
erally described using the rational form version (or the direct form struc- 
ture) of the system function. Hence we will provide MATLAB functions for 
converting direct form structures to cascade and parallel form structures. 


As the name suggests, the difference equation (6.2) is implemented as 
given using delays, multipliers, and adders. For the purpose of illustration, 
let M = N = 4. Then the difference equation is 


y(n) = boz(n) + biz(n — 1) + box(n — 2) + bgx(n — 3) + bax(n — 4) 
— ayy(n — 1) — azy(n - 2) — agy(n — 3) - a4y(n — 4) 


which can be implemented as shown in Figure 6.2. This block diagram is 
called direct form I structure. 

The direct form I structure implements each part of the rational func- 
tion H(z) separately with a cascade connection between them. The nu- 
merator part is a tapped delay line followed by the denominator part, 
which is a feedback tapped delay line. Thus there are two separate de- 
lay lines in this structure, and hence it requires eight delay elements. We 
can reduce this delay element count or eliminate one delay line by inter- 
changing the order in which the two parts are connected in the cascade. 
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MATLAB 
IMPLEMEN- 
TATION 


CASCADE 
FORM 


IIR Filter Structures 


x(n) y(n) 





FIGURE 6.2 Direct form I structure 


Now the two delay lines are close to each other, connected by a unity 
gain branch. Therefore one delay line can be removed, and this reduction 
leads to a canonical structure called direct form II structure, shown in 
Figure 6.3. It should be noted that both direct forms are equivalent from 
the input-output point of view. Internally, however, they have different 
signals. 


In MATLAB the direct form structure is described by two row vectors; 
b containing the {bn} coefficients and a containing the (a4) coefficients. 
The structure is implemented by the filter function, which is discussed 
in Chapter 2. 


In this form the system function H(z) is written as a product of second- 
order sections with real coefficients. This is done by factoring the numer- 
ator and denominator polynomials into their respective roots and then 
combining either a complex conjugate root pair or any two real roots into 
second-order polynomials. In the remainder of this chapter we assume 


x(n) y(n) 





FIGURE 6.3 Direct form IT structure 
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yyUn) = xy 431000 yy 4 10) 





FIGURE 6.4 Biquad section structure 


that N is an even integer. Then 


bo biz 1 +--+ + bn27% 


H = 
(2) L+ayz-14+---+ayz-% 


(6.3) 
b, ,-1 by ,—-N 
z ott te” tec 
lcrajz-4--:-awz-N 


K -1 -2 
Sb JI 1+ Bkz + Bp, 2z 
k=1 


14+ Ak! + Ák227? 


where K is equal to x, and By, Bez, Ax, and Ax,2 are real numbers 
representing the coefficients of second-order sections. The second-order 
section 


Yeqi(z) _ 1+ Byz! t Bkoz 


H = 
(2) Y;(z) 1+ Ak1z7l T Az?’ 





k=1,...,K 
with 
Yi(z) = boX(z); Yx+i(z) = Y(2) 


is called the kth biquad section. The input to the kth biquad section is 
the output from the (k — 1)th biquad section, while the output from the 
kth biquad is the input to the (k + 1)th biquad. Now each biquad section 
H,(z) can be implemented in direct form II as shown in Figure 6.4. The 
entire filter is then implemented as a cascade of biquads. 

As an example, consider N — 4. Figure 6.5 shows a cascade form 
structure for this fourth-order IIR filter. 


x(n) yin 





FIGURE 6.5 Cascade form structure for N =4 
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MATLAB Given the coefficients {bn} and {an} of the direct form filter, we have to 
IMPLEMEN- obtain the coefficients bo, {Bz,i}, and (A). This is done by the function 
TATION dir2cas given below. 


function [b0,B,A] = dir2cas(b,a); i 
% DIRECT-form to CASCADE-form conversion (cplxpair version) 


% [b0,B,A] = dir2cas(b,a) 
% bO = gain coefficient 


% B*K by 3 matrix of real coefficients containing bk’s 
% A= XK by 3 matrix of real coefficients containing ak’s 
% b = numerator polynomial coefficients of DIRECT form 

% a = denominator polynomial coefficients of DIRECT form 


% compute gain coefficient bO 
bO = b(1); b = b/b0; 

a0 = a(1); a = a/a0; 

bO = b0/a0; 

* 

M = length(b); N = length(a); 
if N>M 

b = [b zeros(1,8-M)]; 

elseif M > N 

a = [a zeros(1,M-N)]; N = M; 
else 

NM = 0; 

end 

vA 

K = floor(N/2); B = zeros(K,3); A= zeros(K,3); 
if K*2 == N; 

b = [b 0]; 

a= fa 0); 

end 

4 

broots = cplxpair(roots(b)); 
aroots = cplrpair(roots(a)); 
for i=1:2:24K 

Brow = broots(i:1:i+1,:); 
Brow = real(poly(Brow)); 
B(fix((iti)/2),:) = Brow; 
Arou = aroots(i:i:i*i,:); 
Arow = real(poly(Arow)); 
A(fix((i*1)/2),:) = Arow; 
end 


The above function converts the b and a vectors into Kx3BandA 
matrices. It begins by computing bp, which is equal to bg/ao (assuming 
ao X 1). It then makes the vectors b and a of equal length by zero- 
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padding the shorter vector. This ensures that each biquad has à nonzero 
numerator and denominator. Next it computes the roots of the B(z) and 
A(z) polynomials. Using the cplxpair function, these roots are ordered in 
complex conjugate pairs. Now every pair is converted back into a second- 
order numerator or denominator polynomial using the poly function. 

The cascade form is implemented using a casfiltr function, which 
is described below. It employs the filter function in a loop using the 
coefficients of each biquad stored in B and A matrices. The input is scaled 
by b0, and the output of each filter operation is used as an input to the 
next filter operation. The output of the final filter operation is the overall 
output. 


function y = casfiltr(b0,B,A,x); 

% CASCADE form realization of IIR and FIR filters 

Y, nnn ee ne nn nnn nnn nnn nnn n —— RH! 

% y = casfiltr(b0,B,A,x); 

% y = output sequence 

% bO = gain coefficient of CASCADE form 

% B= XK by 3 matrix of real coefficients containing bk’s 
% A= K by 3 matrix of real coefficients containing ak’s 
% x = input sequence 


[K,L] = size(B); 
N = length(x); 
w = zeros(K+1,N); 
wi,:) = x; 
for i = 1:1:K 
w(iti,:) = filter(B(i,:),ACi,:),wGi,:)); 
end 
y = bO*w(K+1,:); 


The following MATLAB function, cas2dir, converts a cascade form 
to a direct form. This is a simple operation that involves multiplication of 
several second-order polynomials. For this purpose the MATLAB function 
conv is used in a loop over K factors. 


function [b,a] = cas2dir(b0,B,A); 
% CASCADE-to-DIRECT form conversion 


% [b,a] = cas2dir(b0,B,A) 

% b= numerator polynomial coefficients of DIRECT form 
% a= denominator polynomial coefficients of DIRECT form 
% bO = gain coefficient 

X B= K by 3 matrix of real coefficients containing bk’s 
% A=K by 3 matrix of real coefficients containing ak’s 
* 

{K,L] = size(B); 
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b= [1]; 

a = [1]; 

for i-1:1:K 
beconv(b,B(i,:)); 
asconv(a,A(i,:)); 
end 

b = b*b0; 


[m] EXAMPLE 6.1 A filter is described by the following difference equation: 


Solution 


x(n) 





16y(n) + 12y(n — 1) + 2y(n — 2) — 4y(n — 3) — y(n — 4) 
= x(n) — 3z(n — 1) + lla(n — 2) — 27z(n — 3) + 18z(n — 4) 


Determine its cascade form structure. 


MATLAB Script 
>> b=[1 -3 11 -27 18]; 
>> a=[16 12 2 -4 -1]; 
>> [b0,B,A]-dir2cas(b,a) 
bO = 0.0625 
B = 
1.0000 -0.0000 9.0000 
1.0000 -3.0000 2.0000 
A= 
1.0000 1.0000 0.5000 
1.0000  -0.2500  -0.1250 


The resulting structure is shown in Figure 6.6. 'To check that our cascade struc- 


ture is correct, let us compute the first 8 samples of the impulse response using 
both forms. 


>> delta = impseq(0,0,7); 
delta = 
1 0 0 0 0 0 0 0 
>> format long 
>> heas=casfiltr(b0,B,A,delta) 


yin) 


FIGURE 6.6 Cascade structure in Example 6.1. 
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hcas * 
Columns 1 through 4 
0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 
Columns 5 through 8 
2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 
>> hdir=filter(b,a,delta) 
hdir = 
Columns 1 through 4 


0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 
Columns 5 through 8 


2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 
u 





PARALLEL In this form the system function H(z) is written as a sum of second order 
FORM sections using partial fraction expansion (PFE). 


_ Be) _ bo biz ^! +- + byez 

Hus A(z)  l-caz-ic---awz-N (6.4) 
bot be ttt NUR PE 
lta! + e tanz N IA 2 Ckz 


—— 
only i£ M>N 


K zi M-N 
= J __ Brot Bere : + X Ckz^* 
rcl 14 Ak 127! + Åk, 227? o k 


——— 
only if M>N 


where K is equal to x. and Bio, Bri, Ar, and Ax,2 are real numbers 
representing the coefficients of second-order sections. The second-order 
section 


zl 
H(z) = Yk+1(2) _ Brot Braz 


= ————54——3! =1,...,K 
Yk(2) 1+ Akiz^l + Akaz? ie 


with 
Yale) = HAX), YAEY), M<N 


is the kth proper rational biquad section. The filter input is available to 
all biquad sections as well as to the polynomial section if M > N (which 
is an FIR part). The output from these sections is summed to form the 
filter output. Now each biquad section H;,(z) can be implemented in direct 
form II. Due to the summation of subsections, a parallel structure can be 
built to realize H(z). As an example, consider M — N — 4. Figure 6.7 
shows a parallel form structure for this fourth-order IIR filter. 
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y(n) 


FIGURE 6.7 Parallel form structure for N = 4 


MATLAB The function dir2par given below converts the direct form coefficients 
IMPLEMEN- {bn} and {an} into parallel form coefficients {Bk} and {Ax}. 
TATION 


function [C,B,A] = dir2par(b,a); 
% DIRECT-form to PARALLEL-form conversion 


4 (C,B,A] = dir2par(b,a) 

% C= Polynomial part when length(b) >= length(a) 

4 B= K by 2 matrix of real coefficients containing bk’s 
% A=K by 3 matrix of real coefficients containing ak’s 
% b = numerator polynomial coefficients of DIRECT form 
% a = denominator polynomial coefficients of DIRECT form 
% 

M = length(b); N = length(a); 


[ri,pi,C) = residuez(b,a) ; 


p = cplxpair(pi, 10000000*eps) ; 

I cplxcomp(pi,p); 

r = r1(D; 

K = floor(N/2); B = zeros(K,2); A = zeros (K,3); 


if K*2 == N; AN even, order of A(z) odd, one factor is first order 
for i=1:2:N-2 

Brow = r(i:1:i*1,:); 

Arow = p(i:i:itl,:); 

(Brow, Arow] = residuez(Brow, Arow, [}); 

B(fix((it1)/2),:) = real (Brow) ; 

A(fix((it1)/2),:) = real (Arow) ; 

end 

[Brow, Arow] = residuez(r(N-1) »p(N-1), 1); 

B(K,:) = [real(Brow) 0]; A(K,:) = {real (Arow) 0]; 
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else 
for i-1:2:N-1 
Brow = r(i:1:i*1,:); 
Arow = p(i:i:i*i,:); 
[Brow,Arow] = residuez(Brow, Arow, []); 
B(fix((it1)/2),:) = real(Brow) ; 
A(fix((it1)/2),:) = real(Arow); 
end 
end 


The dir2cas function first computes the z-domain partial fraction expan- 
sion using the residuez function. We need to arrange pole-and-residue 
pairs into complex conjugate pole-and-residue pairs followed by real pole- 
and-residue pairs. To do this, the cplxpair function from MATLAB can 
be used; this sorts a complex array into complex conjugate pairs. How- 
ever, two consecutive calls to this function, one each for pole and residue 
arrays, will not guarantee that poles and residues will correspond to each 
other. Therefore a new cplxcomp function is developed, which compares 
two shuffled complex arrays and returns the index of one array, which can 
be used to rearrange another array. 


function I = cplxcomp(p1,p2) 
% I cplxcomp(pi,p2) 
% Compares two complex pairs which contain the same scalar elements 
% but (possibly) at differrent indices. This routine should be 
% used after CPLXPAIR routine for rearranging pole vector and its 
% corresponding residue vector. 
* p2 = cplxpair(p1) 
* 
I=[]; 
for j=1:1:length(p2) 

for i=1:1:length(pt) 
if (abs(pi(i)-p2(j)) < 0.0001) 

I=[I,i]; 

end 

end 
end 
I-I'; 


After collecting these pole-and-residue pairs, the dir2cas function com- 
putes the numerator and denominator of the biquads by employing the 
residuez function in the reverse fashion. 

These parallel form coefficients are then used in the function 
parfiltr, which implements the parallel form. The parfiltr function 
uses the filter function in a loop using the coefficients of each biquad 
stored in the B and A matrices. The input is first filtered through the FIR 
part C and stored in the first row of a w matrix. Then the outputs of all 
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biquad filters are computed for the same input and stored as subsequent 
rows in the w matrix. Finally, all the columns of the w matrix are summed 
to yield the output. 


function y = parfiltr(C,B,A,x); 
% PARALLEL form realization of IIR filters 
% wwe ee an a ee oe wr ee 
% [y] = parfiltr(C,B,A,x); 
X y = output sequence 
4 C = polynomial (FIR) part when M >= N 
% B= K by 2 matrix of real coefficients containing bk's 
4 A-K by 3 matrix of real coefficients containing ak's 
% x = input sequence 
* 
[K,L] = size(B); 
N = length(x); 
w = zeros(K*1,N); 
w(1,:) = filter(C,1,x); 
for i = 1:1:K 
v(i*1,:) = filter(B(i,:),ACi,:),x); 
end 
y = sum(w); 


To obtain a direct form from a parallel form, the function par2dir can 
be used. It computes poles and residues of each proper biquad and com- 
bines these into system poles and residues. Another call of the residuez 
function in reverse order computes the numerator and denominator poly- 
nomials. 


function [b,a] = par2dir(C,B,A); 

% PARALLEL-to-DIRECT form conversion 

Y =--------------------------------- 

% [b,a] = par2dir(C,B,A) 

% b = numerator polynomial coefficients of DIRECT form 

a = denominator polynomial coefficients of DIRECT form 

C = Polynomial part of PARALLEL form 

% B= K by 2 matrix of real coefficients containing bk’s 
A = K by 3 matrix of real coefficients containing ak’s 

* 

[K,L] = size(0; R= (1; P = D; 


for i=1:1:K 
[r,p,k]=residuez(B(i,:),ACi,:)); 
R = [R;r]; P = [P;p]; 

end 

[b,a] = residuez(R,P,C); 

b= b(:)?; a= aC); 
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a EXAMPLE 6.2 Consider the filter given in Example 6.1. 
16y(n) + 12y(n — 1) + 2y(n — 2) - 4y(n - 3) — y(n - 4) 
= a(n) — 3z(n — 1) + 11z(n ~ 2) - 27z(n — 3) + 18z(n — 4) 


Now determine its parallel form. 


Solution MATLAB Script c —————————————————————— 
>> be[1 -3 11 -27 18]; 
>> ae[16 12 2 -4 -1); 
>> [C,B,Alsdir2par(b,a) 
C= 
-18 
Be 
10.0500 -3.9500 
28.1125 -13.3625 
A= 
1.0000 1.0000 0.5000 
1.0000 -0.2500 -0.1250 


The resulting structure is shown in Figure 6.8. To check our parallel structure, 
let us compute the first 8 samples of the impulse response using both forms. 


>> format long; delta = impseq(0,0,7); 
>> hpar=parfiltr(C,B,A,delta) 
hpar = 
Columns i through 4 
0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 


xin) yin) 


FIGURE 6.8 Parallel form structure in Example 6.2. 
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Columns 5 through 8 

2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 
>> hdir = filter(b,a,delta) i 
hdir = 

Columns 1 through 4 

0.06250000000000 -0.23437500000000 0.85546875000000 -2.28417968750000 

Columns 5 through 8 

2.67651367187500 -1.52264404296875 0.28984069824219 0.49931716918945 

o 


o EXAMPLE 6.3 What would be the overall direct, cascade, or parallel form if a structure contains 
a combination of these forms? Consider the block diagram shown in Figure 6.9. 


Solution This structure contains a cascade of two parallel sections. The first parallel 
section contains two biquads, while the second one contains three biquads. We 
will have to convert each parallel section into a direct form using the par2dir 
function, giving us a cascade of two direct forms. The overall direct form can be 
computed by convolving the corresponding numerator and denominator poly- 
nomials. The overall cascade and parallel forms can now be derived from the 
direct form. 


>> CO=0; Bi=[2 4;3 1]; At=[1 1 0.9; 1 0.4 -0.4]; 
>> B2#[0.5 0.71.5 2.5;0.8 1]; A2=[1 -1 0.831 0.5 0.531 0 -0.5]; 
>> [bi,ai]-par2dir(CO,B1,A1) 
bi = 
5.0000 8.8000 4.5000 -0.7000 


x(n) 


FIGURE 6.9 Block diagram in Example 6.3 
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al = This example shows that by using the MATLAB functions developed in this 
1.0000 1.4000 0.9000 -0.0400 -0.3600 section, we can probe and construct a wide variety of structures. ü 
>> [b2,a2]-par2dir(CO,B2,42) 
b2 = 

2.8000 2.5500 -1.5600 2.0950 0.5700 -0.7750 
a2 = FIR FILTER STRUCTURES 


1.0000 -0.5000 0.3000 0.1500 0.0000 0.0500 -0.2000 
>> b=conv(bi,b2) % Overall direct form numerator 
b= A finite-duration impulse response filter has a system function of the form 


Columns 1 through 7 


14.0000 37.3900 27.2400 6.2620 12.4810 11.6605 -5.7215 K 
Columns 8 through 9 H(z) = bo biz! + tbm- = Y baz (6.5) 
-3.8865 0.5425 n=0 
>> asconv(ai,a2) % Overall direct form denominator 
a= Hence the impulse response h(n) is 
Colums 1 through 7 
1.0000 0.9000 0.5000 0.0800 0.1400 0.3530 -0.2440 h(n) = i )SnS M (6.6) 
Columns 8 through 11 0, else 
-0.2890 -0.1820 -0.0100 0.0720 
>> [b0,Bc,Ac]=dir2cas(b,a) % Overall cascade form and the difference equation representation is 
b0 = 
14.0000 y(n) = boz(n) + bia(n - 1) +: + by iz(n — M +1) (6.7) 
Bc = 

1.0000 1.8836 1.1328 ` which is a linear convolution of finite support. 

1.0000 -0.6915 0.6719 The order of the filter is M — 1, while the length of the filter (which 

1.0000 2.0776 0.8666 is equal to the number of coefficients) is M. The FIR filter structures are 

1.0000 0 0 always stable, and they are relatively simple compared to IIR structures. 

1.0000 -0.5990 0.0588 Furthermore, FIR filters can be designed to have a linear-phase response, 
Ac = which is desirable in some applications. 

1.0000 1.0000 0.9000 We will consider the following four structures: 

1.0000 0.5000 0.5000 

1.0000  -1.0000 0.8000 e Direct form: In this form the difference equation (6.7) is imple- 

1.0000 1.5704 0.6105 mented directly as given. 

1.0000 -1.1704 0.3276 e Cascade form: In this form the system function H(z) in (6.5) is fac- 
>> [CO,Bp,Apledir2par(b,a) % Overall parallel form tored into second-order factors, which are then implemented in a cascade 
" x H connection. 

-20.4201 -1.6000 e Linear-phase form: When an FIR filter has a linear phase response, 

24.1602 5.1448 its impulse response exhibits certain symmetry conditions. In this form 

2.4570 3.3774 we exploit these symmetry relations to reduce multiplications by about 

-0.8101 -0.2382 half. 

8.6129 -4.0439 e Frequency sampling form: This structure is based on the DFT of 
Ap = the impulse response h(n) and leads to a parallel structure. It is also suit- 
.0000 1.0000 0.9000 able for a design technique based on the sampling of frequency response 


.0000 0.5000 0.5000 H (e). 


1 
1 
1.0000 -1.0000 0.8000 
1.0000 1.5704 0.6105 We will briefly describe the above four forms along with some exam- 
1 


.0000 -1.1704 0.3276 ples. The MATLAB function dir2cas developed in the previous section is 
also applicable for the cascade form. 
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xin) 
Rr pi pi pi p 
yin) 


FIGURE 6.10 Direct form FIR structure 


The difference equation (6.7) is implemented as a tapped delay line since 
there are no feedback paths. Let M = 5 (i.e., a fourth-order FIR filter); 
then 


y(n) = box(n) + biz(n — 1) + baz(n — 2) + baz(n — 3) + baz(n — 4) 


The direct form structure is given in Figure 6.10. Note that since the 
denominator is equal to unity, there is only one direct form structure. 


In MATLAB the direct form FIR structure is described by the row vector 
b containing the {bn} coefficients. The structure is implemented by the 
filter function, in which the vector a is set to the scalar value 1 as 
discussed in Chapter 2. 


This form is similar to that of the IIR form. The system function H (z) 
is converted into products of second-order sections with real coefficients. 
These sections are implemented in direct form and the entire filter as à 
cascade of second-order sections. From (6.5) 


H(z) = bo biz! 4 tbm- M (6.8) 
bi —1 bui pe 
=b (1+5 +e +A 
bo ( k bo z 


K 
= bo II (i + Byz! t Byaz ?) 
k=1 


where K is equal to (4, and By, and By? are real numbers representing 
the coefficients of second-order sections. For M — 7 the cascade form is 
shown in Figure 6.11. 


xin) y(n) 





FIGURE 6.11 Cascade form FIR structure 
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Although it is possible to develop a new MATLAB function for the FIR 
cascade form, we will use our dir2cas function by setting the denominator 
vector a equal to 1. Similarly, cas2dir can be used to obtain the direct 
form from the cascade form. 


For frequency-selective filters (e.g., lowpass filters) it is generally desirable 
to have a phase response that is a linear function of frequency; that is, we 
want 


LH(e") -8—ow, -"«wtzm (6.9) 


where f = 0 or +7/2 and a is a constant. For a causal FIR filter with 
impulse response over [0, M — 1] interval, the linear-phase condition (6.9) 
imposes the following symmetry conditions on the impulse response h(n): 


h(n) = h(M -1-—n) B=0,0<n<M-1 | (6.10) 

A(n) 2—h(M-1-n) p= +r/2, O0<n<M-1_ (611) 
An impulse response that satisfies (6.10) is called a symmetric impulse 
response, while that in (6.11) is called an antisymmetric impulse response. 
These symmetry conditions can now be exploited in a structure called the 
linear-phase form. 


Consider the difference equation given in (6.7) with a symmetric im- 
pulse response in (6.10). We have 


y(n) = boz(n) + byz(n — 1) +--+ + biz(n ~ M + 2) + boz(n - M +1) 
= bo[r(n) + z(n — M - 2] - ilz(n - 1) c z(n- M £2) t 


The block diagram implementation of the above difference equation is 
shown in Figure 6.12 for both odd and even M. 





FIGURE 6.12 Linear phase form FIR structures (symmetric impulse response) 
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Clearly, this structure requires 5076 fewer multiplications than the di- 
rect form. A similar structure can be derived for an antisymmetric impulse 


response. 

MATLAB The linear-phase structure is essentially a direct form drawn differently to 
IMPLEMEN- save on multiplications. Hence in a MATLAB implementation the linear- 
TATION phase structure is equivalent to the direct form. 


ü EXAMPLE 64 An FIR filter is given by the system function 


" d 4, os 
H(z) =1+ 16752 +z 


Determine and draw the direct, linear-phase, and cascade form structures. 
a. Direct form: The difference equation is given by 
y(n) = x(n) + 16.06252(n — 4) + z(n — 8) 


and the direct form structure is shown in Figure 6.13(a). 
b. Linear-phase form: The difference equation can be written in the form 


y(n) = [z(n) + «(n — 8)] + 16.0625z(n — 4) 


and the resulting structure is shown in Figure 6.13(b). 
c. Cascade form: 


>> b=[1,0,0,0,16+1/16,0,0,0,1]; 
>> [b0,B,A] = dir2cas(b,1) 


x(n) 





y(n) 
(b) Linear-phase form 


x(n) yin 





(c) Cascade form 


FIGURE 6.13 FIR filter structures in Example 6.4 
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bo = 1 
Be 
1.0000 2.8284 4.0000 
1.0000 0.7071 0.2500 
1.0000 -0.7071 0.2500 
1.0000 -2.8284 4.0000 
A= 
1 0 o 
1 0 0 
1 0 0 
1 0 0 
The cascade form structure is shown in Figure 6.13(c). o 


For the filter in Example 6.4 what would be the structure if we desire a cascade 
form containing linear-phase components with real coefficients? 


We are interested in cascade sections that have symmetry and real coefficients. 
From the properties of linear-phase FIR filters (see Chapter 7), if such a filter 
has an arbitrary zero at z = r40, then there must be three other zeros at 
(1/r)20, rZ —0, and (1/r)Z —0 to have real filter coefficients. We can now make 
use of this property. First we will determine the zero locations of the given 
eighth-order polynomial. Then we will group four zeros that satisfy the above 
property to obtain one (fourth-order) linear-phase section. There are two such 
sections, which we will connect in cascade. 


>> bs[1,0,0,0,16*1/16,0,0,0,1]; 
>> broots=roots(b) 


broots = 
-1.4142 + 1.4142i 
-1.4142 - 1.4142i 
1.4142 * 1.4142i 
1.4142 - 1.4142i 
-0.3536 + 0.3536i 
-0.3536 - 0.3536i 


0.3536 + 0.3536i 
0.3536 - 0.3536i 
>> Bi=real (poly ({broots(1) ,broots (2) ,broots (5) ,broots(6)])) 
Bi = 
1.0000 3.5355 6.2500 3.5355 1.0000 
>> B2ereal(poly([broots(3),broots(4) ,broots(7) ,broots (8)])) 
B2 = 
1.0000 -3.5355 6.2500 -3.5355 1.0000 


The structure is shown in Figure 6.14. D 
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FIGURE 6.14 Cascade of FIR linear-phase elements 


In this form we use the fact that the system function H (z) of an FIR 
filter can be reconstructed from its samples on the unit circle. From our 
discussions on the DFT in Chapter 5 we recall that these samples are in 
fact the M-point DFT values {H (k), 0<k< M — 1} of the M-point 
impulse response A (n). Therefore we have 


H (2) = Z [h (n) 
= Z [IDFT {H ())] 


Using this procedure, we obtain [see (5.17) on page 127] 





_ (ine \  H(B 
HAS ( M ) 2/3 zwi ue 


k=0 


This shows that the DFT H (k), rather than the impulse response h (n) 
(or the difference equation), is used in this structure. It is also interesting 
to note that the FIR filter described by (6.12) has a recursive form similar 
to an ITR filter because (6.12) contains both poles and zeros. The resulting 
filter is an FIR filter since the poles at Wf are canceled by the roots of 


The system function in (6.12) leads to a parallel structure as shown in 
Figure 6.15 for M — 4. 

One problem with the structure in Figure 6.15 is that it requires a 
complex arithmetic implementation. Since an FIR filter is almost always a 
real-valued filter, it is possible to obtain an alternate realization in which 
only real arithmetic is used. This realization is derived using the symmetry 
properties of the DFT and the Wit factor. Then (6.12) can be expressed 


202 Chapter 6 8& DIGITAL FILTER STRUCTURES 





FIR Filter Structures 


y(n) 


FIGURE 6.15 Frequency sampling structure forM=4 
as (see Problem 6.10) 


H()s te 





L 
[row Mme HO + gem] (6.13) 
k=1 


z7! 14273 


where L = Mz for M odd, L = M —1 for M even, and {Hx (z), k=1, 
..., L} are second-order sections given by 


cos [ZH (k)] — z^! cos [ZH (k) — zek] 


H, = 
r (2) 1 — 2z2-!cos (355) +272 





(6.14) 


Note that the DFT samples H (0) and H (M/2) are real-valued and that 
the third term on the right-hand side of (6.13) is absent if M is odd. Using 
(6.13) and (6.14), we show a frequency sampling structure in Figure 6.16 
for M = 4 containing real coefficients. 


cosLZH(1) — 2|H(1)] 


aose 
ar —cosLZ H(1) - 27/4] 










FIGURE 6.16 Frequency sampling structure for M =4 with real coefficients 
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Given the impulse response h(n) or the DFT H (k), we have to deter- 
mine the coefficients in (6.13) and (6.14). The following MATLAB function, 
dir2fs, converts a direct form (h (n) values) to the frequency sampling 
form by directly implementing (6.13) and (6.14). 


function [C,B,A] = dir2fs(h) 
% Direct form to Frequency Sampling form conversion 


% [C,B,A) = dir2fs(h) 
% C = Row vector containing gains for parallel sections 
4 B = Matrix containing numerator coefficients arranged in rows 
% A = Matrix containing denominator coefficients arranged in rows 
% h = impulse response vector of an FIR filter 
* 
M = length(h); 
H = fft(h,M; 
magH = abs(H); phaH = angle(H)’; 
% check even or odd M 
if (M == 2*floor(M/2)) 
L = M/2-1; XMis even 
AL = (1,-1,0;1,1,0]; 
C1 = [real (H(1)),real(H(L+2))1; 


L = (M-1)/2; % M is odd 
Ai = [1,-1,0]; 
C1 = [real(H(1)]; 


end 

k = [1:L]?; 

% initialize B and A arrays 

B = zeros(L,2); A = ones(L, 3; 

% compute denominator coefficients 
A(1:L,2) = -2*cos(2*+pi*k/M); A = [A;A1]; 
% compute numerator coefficients 
B(1:L,1) = cos(phaH(2:L*1)); 

B(1:L,2) = -cos(phaH(2:L*1)- (2*pi*k/M)) ; 
% compute gain coefficients 

C = [2*magH(2:L41),C1]*; 


In the above function the impulse response values are supplied through the 
h array. After conversion, the C array contains the gain values for each 
parallel section. The gain values for the second-order parallel sections 
are given first, followed by H (0) and H (M/2) (if M is even). The B 
matrix contains the numerator coefficients, which are arranged in length- 
2 row vectors for each second-order section. The A matrix contains the 
denominator coefficients, which are arranged in length-3 row vectors for 
the second-order sections corresponding to those in B, followed by the 
coefficients for the first-order sections. 
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A practical problem with the structure in Figure 6.16 is that it has 
poles on the unit circle, which makes this filter critically unstable. If the 
filter is not excited by one of the pole frequencies, then the output is 
bounded. We can avoid this problem by sampling H (z) ona circle |z| — r, 
where the radius is véry close to one but is less than one (e.g., r = 0.99), 
which results in 





H (2) = —— ; H (k) = H (rei) 
z 
(6.15) 
Now approximating H (re??**/M) ~ H (ei?**/M) for r ~ 1, we can obtain 


a stable structure similar to the one in Figure 6.16 containing real values. 
This is explored in Problem 6.11. 


Let h (n) = 3{1, 2,3, 2, 1). Determine and draw the frequency sampling form. 
t 


MATLAB Script ——————— 
>> h = [1,2,3,2,1]/9; 
>> [C,B,À] = dir2fs(h) 


C= 
0.5818 
0.0849 
1.0000 
B= 
-0.8090 0.8090 
0.3090 -0.3090 
A= 


1.0000 -0.6180 1.0000 
1.0000 1.6180 1.0000 
1.0000 -1.0000 o 


M 


Since M — 5 is odd, there is only one first-order section. Hence 








1-25 —0.809 + 0.8092! 
Huy 0.98187 5,618271 + 2? 
0.309 — 0.30927! 1 
+ 0.08487 6182-1 +2"? 1- =| 
The frequency sampling form is shown in Figure 6.17. n 
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Solution 


—0.809 0.5818 






0.0848 
y(n) 


FIGURE 6.17 Frequency sampling structure in Ezample 6.6 


The frequency samples of a 32-point linear-phase FIR filter are given by 


1 k=0,1,2 
|H (k)| = 40.5, k=3 
0, k=4,5,...,15 


Determine its frequency sampling form, and compare its computational com- 
plexity with the linear-phase form. 


In this example since the samples of the DFT H (k) are given, we could use 
(6.13) and (6.14) directly to determine the structure. However, we will use the 
dix2fs function for which we will have to determine the impulse response h (n). 


Using the symmetry property and the linear-phase constraint, we assemble the 
DFT H (k) as 


H (k) = |H (K 9^" 9, k-0,1,...,31 
|H(k) = |H (32-kK), k-212..,35 H(0) -1 


LH (k) = ok = LH G2 - E), k=0,1,...,31 


Now the IDFT of H (k) will result in the desired impulse response. 


>> M = 32; alpha = (M-1)/2; 

>> magHk = [1,1,1,0.5,zeros(1,25),0.5,1,1]; 

>> ki = 0:15; k2 = 16:M-1; 

>> angik = [-alpha*(2*pi)/M*k1, alpha» (2*pi) /M*(M-k2)] ; 
>> H = magHk.*exp(j*angHk); 

>> h = real (ifft(H,M)); 

>> (C,B,A] = dir2fs(h) 


a 
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A= 
1.0000 -1.9616 1.0000 
1.0000 -1.8478 1.0000 
1.0000 -1.6629 1.0000 
1.0000 -1.4142 1.0000 
1.0000 -1.1111 1.0000 
1.0000 -0.7654 1.0000 
1.0000 -0.3902 1.0000 
1.0000 0.0000 1.0000 
1.0000 0.3902 1.0000 
1.0000 0.7654 1.0000 
1.0000 1.1111 1.0000 
1.0000 1.4142 1.0000 
1.0000 1.6629 1.0000 


FIR Filter Structures 





1.0000 1.8478 1.0000 
1.0000 1.9616 1.0000 
1.0000 -1.0000 0 
1.0000 1.0000 0 


Note that only four gain coefficients are nonzero. Hence the frequency sampling 
form is 
970.9952 + 0.99522! + 2.09808 = 0.980827" 
1-9 11.96162 1 +27? 1-184787! z7? 
32 —0.9569 + 0.956927! 1 
1—1.66292-! +z7? © 1-27! 


H(z)- 





To determine the computational complexity, note that since H (0) — 1, the first- 
order section requires no multiplication, while the three second-order sections 
require three multiplications each for a total of nine multiplications per output 
sample. The total number of additions is 13. To implement the linear-phase 
structure would require 16 multiplications and 31 additions per output sample. 
Therefore the frequency sampling structure of this FIR filter is more efficient 
than the linear-phase structure. o 


LATTICE FILTER STRUCTURES 
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ALL-ZERO 
LATTICE 
FILTERS 


The lattice filter is extensively used in digital speech processing and in 
the implementation of adaptive filters. It is a preferred form of realization 
over other FIR or IIR filter structures because in speech analysis and in 
speech synthesis the small number of coefficients allows a large number of 
formants to be modeled in real time. The all-zero lattice is the FIR filter 
representation of the lattice filter, while the lattice ladder is the IIR filter 
representation. 


An FIR filter of length M (or order M — 1) has a lattice structure with 
M —1 stages as shown in Figure 6.18. Each stage of the filter has an input 
and output that are related by the order-recursive equations [19]: 


Ím(n) = fm-1(0) + Kmgm-i(n = 1), m=1,2,... ,M-1 


(6.16) 

Om() = Km fm-1(n) + 9-1(n — 1, m=1,2,...,M -1 
where the parameters Km, m = 1,2,..., M — 1, called the reflection 
coefficients, are the lattice filter coefficients. If the initial values of fm(n) 
and gm(m) are both the scaled value (scaled by Ko) of the filter input 
z(n), then the output of the (M — 1) stage lattice filter corresponds to 
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fon) fin) fn fm- i) fim 


\ A y(n) 
x(n) K2 Kyu 
/X M 


gain) gin) gin) gin) gui) 





FIGURE 6.18 All-zero lattice filter 
the output of an (M — 1) order FIR filter; that is, 


fo(n) = go(n) = Koz(n) 
y(n) = fu-i(n) 
If the FIR filter is given by the direct form 


M-1 M-1 b 
H(z) = Y, bmz™™ = bo ( +5 i7) (6.18) 


(6.17) 


m=0 m=1 


and if we denote the polynomial Am-1(2) by 


M-1 
Am-1(z) = ( T 35 d H (6.19) 
m=1 


au-i(m) = 92, m, Mc 


then the lattice filter coefficients {Km} can be obtained by the following 
recursive algorithm [19]: 


Ko = bo 
Km-1 =QM-1 (M me. 1) " 
=z -1). -M— 
Jm (2) = 2 bd y 3 m=M-—1,...,1 (6.20) 
Am(z) ^ KmJm(z 
Amaal) = —S4 re m=M-—1,...,1 
Km = od (m), m=M-—2,...,1 


Note that the above algorithm will fail if |Km| = 1 for any m = 15:55 
M - 1. Clearly, this condition is satisfied by linear-phase FIR filters since 


bM- 
bo = buil = Kual = lani = D= [| = 


Therefore linear-phase FIR filters cannot be implemented using lattice 
structures. 
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Given the coefficients {b,} of the direct form, we can obtain the lattice 
filter coefficients {Km} using (6.20). This is done by the MATLAB func- 
tion dir2latc given below. Note that the equation to compute Jm(z) 
implies that the polynomial Ja (z) is a fliplr operation on the Am(z) 
polynomial. 


function [K] = dir2latc(b) 

Y, FIR Direct form to All-Zero Lattice form Conversion 
% [K] = dir21atc(b) 

% K= Lattice filter coefficients (reflection coefficients) 
% b = FIR direct form coefficients (impulse response) 
4 

M = length(b); 

K = zeros(1,M); 

pi = b(1); 

if bi == 0 

error('b(1) is equal to zero’) 

end 

K(1) = bi; A = b/bi; 

for mzM:-1:2 

K(m) = A(m); 

J = fliplr(A); 

A = (A-K(m)*J)/(1-K(m)*K(m)); 

A = A(1:n-1); 

end 


The lattice filter is implemented using (6.16) and (6.17), which is done by 
a latcfilt function, which is given below. 


function [y] = latcfilt(K,x) 
% LATTICE form realization of FIR filters 


4 y = latcfilt(K,x) 
% y = output sequence 
X K= LATTICE filter (reflection) coefficient array 
% x= input sequence 
* 
Nx = length(x)-1; 
x = K(1)*x; 
M = length(K)-1; K = K(2:M+1); 
fg = (x; [0 x(1:Nx)]]; 
for m = 1:M 
fg = [1,K(m);K(m) , 1]*fg; 
fg(2,:) = [0 fg(2, 1:80); 
end 
y = fg(1,:); 
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The equations (6.20) can also be used to determine the direct form 
coefficients {bm} from the lattice filter coefficients {K,,} using a recursive 
procedure [19]: 


Ao(z) = Jo(z) =1 

Am(z) = Am-1 (z) + Kmz !Jm-1(2), M= 12,...,M-1 

Jin(Z) = 27 Am (277), ` m-12,..,M-1 
bm = Koam-1(m), m —0,1,...,M-1 


The MATLAB function latc2dir given below implements (6.21). Note 
that the product Km27}Jm-1 (z) is obtained by convolving the two cor- 
responding arrays, while the polynomial Jm(z) is obtained by using a 
fliplr operation on the Am(z) polynomial. 


function [b] = latc2dir(K) 

4 All-Zero Lattice form to FIR Direct form Conversion 
Y, ----------------------------=----= 22-2772 
% [b] = latc2dir(K) 

% b= FIR direct form coefficients (impulse response) 
% K= Lattice filter coefficients (reflection coefficients) 
* 

M = length(K); 

J=1; A 1; 

for m=2:1:M 

A = [A,0]+conv([0,K(m)],J); 

J = fliplr(A); 

end 

bzA*K(1) ; 


An FIR filter is given by the difference equation 
13 5 2 
y(n) = 2z(n) + i -1)- 120 -2)- 37(^ — 3) 


Determine its lattice form. 


MATLAB Script ———————————— 
>> b=(2, 13/12, 5/4, 2/3]; 
>> K=dir2late(b) 
K = 
2.0000 0.2500 0.5000 0.3333 
LL 


Hence 


a || | 
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x(n) 


y(n) 


yin} 





FIGURE 6.19 FIR filter structures in Example 6.8: (a) Direct form (b) Lattice 
form 


The direct form and the lattice form structures are shown in Figure 6.19. To 
check that our lattice structure is correct, let us compute the impulse response 
of the filter using both forms. 


>> [x,n] = impseq(0,0,3]; 
>> format long 
>> hdirect=filter(b,1,delta) 
hdirect = 
2.00000000000000 1.08333333333333 1.25000000000000 0.66666666666667 
>> hlattice=latcfilt(K,delta) 
hlattice = 
2.00000000000000 1.08333333333333 1.25000000000000 0. 66666666666667 
o 


A lattice structure for an IIR filter is restricted to an all-pole system 
function. It can be developed from an FIR lattice structure. Let an all- 
pole system function be given by 


1 


H(z) = (6.22) 


N 


1+ D an(m)z~-™ 
m=1 


which from (6.19) is equal to H(z) = RO: Clearly, it is an inverse 
system to the FIR lattice of Figure 6.18 (except for factor bo). This IIR 
filter of order N has a lattice structure with N stages as shown in Figure 
6.20. Each stage of the filter has an input and output that are related by 
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FIGURE 6.20 All-pole lattice filter 


the order-recursive equations [19]: 
fn(n) = z(n) 
fm-1(2) = fin(n) ^ Kmgm-i(n — 1), m=N,N-1,...,1 
gm (n) = Kmfm—1(n) + 9m—1(n— 1), m- N, N-1,...,1 
y(n) = fo(n) = goln) 


(6.23) 


where the parameters Km, m — 1,2,..., M — 1, are the reflection coef- 
ficients of the all-pole lattice and are obtained from (6.20) except for Ko, 
which is equal to 1. 


Since the IIR lattice coefficients are derived from the same (6.20) proce- 
dure used for an FIR lattice filter, we can use the dir2latc function in 
MATLAB. Care must be taken to ignore the Ko coefficient in the K array. 
Similarly, the latc2dir function can be used to convert the lattice {Km} 
coefficients into the direct form {ay(m)} provided that Ko = 1 is used as 
the first element of the K array. The implementation of an IIR lattice is 
given by (6.23), and we will discuss it in the next section. 


Consider an all-pole IIR filter given by 


1 


H(z) = ——=-—_"—_—_- 
(2) 1+ 32-1 + 82-7 + 5273 


Determine its lattice structure. 





EEE 


MATLAB Script 
>> a=[1, 13/24, 5/8, 1/3]; 
>> Kedir2latc(b) 
K = 
1.0000 0.2500 0.5000 0.3333 


a 


Hence 
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FIGURE 6.21 IIR filter structures in Example 6.9: (a) Direct form (b) Lattice 
form 


The direct form and the lattice form structures of this IIR filter are shown in 
Figure 6.21. a 


A general IIR filter containing both poles and zeros can be realized as 
a lattice-type structure by using an all-pole lattice as the basic building 
block. Consider an IIR filter with system function 





H(z) = —— — = Bu) (6.24) 


where, without loss of generality, we assume that N 2 M. A lattice- 
type structure can be constructed by first realizing an all-pole lattice 
with coefficients Km, 1 € m < N for the denominator of (6.24), and 
then adding a ladder part by taking the output as a weighted linear 
combination of {gm(n)} as shown in Figure 6.22 for M = N. The result 





x(n) = fy(n fy - 0) 


FIGURE 6.22 Lattice-ladder structure for realizing a pole-zero IIR füter. 
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is a pole-zero IIR filter that has the lattice-ladder structure. Its output is 
given by 


g | 
y(n) = Y Omgm(n) (6.25) 


m=0 


where {Cm} are called the ladder coefficients that determine the zeros of 
the system function H(z). It can be shown [19] that {Cm} are given by 


M 
Bu(2) = Ý CmJm(2) (629) 


m=0 


where Jm(z) is the polynomial in (6.20). From (6.26) one can obtain a 
recursive relation 


Brn (z) = Bm—1(z) + CmIm(z); m —0,2,...,M 


or equivalently, 


M 
Cm =m + Y, Ce(i- m; m=M,M~1,...,0 (627) 


t=m+1 


from the definitions of Bm(z) and Am(z). 


To obtain a lattice-ladder structure for a general rational IIR filter, we 
can first obtain the lattice coefficients {Km} from Aw (z) using the recur- 
sion (6.20). Then we can solve (6.27) recursively for the ladder coefficients 
{Cm} to realize the numerator By(z). This is done in the MATLAB func- 
tion dir2ladr given below. It can also be used to determine the all-pole 
lattice parameters when the array b is set to b= [1]. 


function [K,C] = dir2ladr(b,a) 

% IIR Direct form to pole-zero Lattice/Ladder form Conversion 

Y, nnn nn nnn nnn nnn nnn a 

% [5 C) = dir2ladr(b,a) 

% K= Lattice coefficients (reflection coefficients), [K1,...,KN] 
% C = Ladder Coefficients, [co,...,CN] 

% b = Numerator polynomial coefficients (deg <= Num deg) 

% a = Denominator polynomial coefficients 

1 


ai = a(1); a = a/ai; b = b/al; 
M = length(b); N = length(a); 
ifM»N 
error(^  *** length of b must be <= length of a ww?) 
end 


D —————————————————— — OS, 
215 


Lattice Filter Structures 


b = [b, zeros(1,N-M)]; K = zeros(1,N-1); 
A = zeros(N-1,N-1); C = b; 
for m = N-1:-1:1 
A(m,1:m) = -a(2:mti)*C(mt1); 
K(m) = a(m+1); 
J = flipir(a); 
a = (a-K(m)*J)/(1-K(m) #K(m)) ; 
a = a(1:m; : 
C(m) = b(m) + sum(diag(A(m:N-1,1:N-m))); 
end 


Note: To use this function, N > M. If M > N, then the numerator 
An/(z) should be divided into the denominator By(z) using the deconv 
function to obtain a proper rational part and a polynomial part. The 
proper rational part can be implemented using a lattice-ladder structure, 
while the polynomial part is implemented using a direct structure. 

To convert a lattice-ladder form into a direct form, we first use the 
recursive procedure in (6.21) on {Km} coefficients to determine {an(k)} 
and then solve (6.27) recursively to obtain {bm (k)}. This is done in the 
MATLAB function ladr2dir given below. 


function (b,a] = ladr2dir(K,C) 
4%, Lattice/Ladder form to IIR Direct form Conversion 


% [b,a] = ladr2dir(K,C) 

% b = numerator polynomial coefficients 

% a = denominator polymonial coefficients 

% K = Lattice coefficients (reflection coefficients) 
% C = Ladder coefficients 


N = length(K) ; M = length(C); 
C = (C, zeros(1,N-M*1)]; 
J= 4; a= 1; A= zeros(N,N); 
for m=1:1:N 
a = (a,0]+conv([0,K(m)],J); 
A(m,1:m) = -a(2:mti); 
J = flipir(a); 
end 
b(N+1) = C(N+1); 
for m = N:-1:1 
A(m,i:m) = A(m,1:m)*C(m+1); 
b(m) = C(m) - sum(diag(A(m:N,1:N-m+1))); 
end 


The lattice-ladder filter is implemented using (6.23) and (6.25). This 
is done in the MATLAB function ladrfilt, which is given below. It should 
be noted that due to the recursive nature of this implementation along 


o a Mec 


Chapter 6 & DIGITAL FILTER STRUCTURES 


O EXAMPLE 6.10 


with the feedback loops, this MATLAB function is neither an elegant nor 
an efficient method of implementation. It is not possible to exploit MAT- 
LAB’s inherent parallel processing capabilities in implementing this lattice- 
ladder structure. 


function [y] = ladrfilt(K,C,x) 
X LATTICE/LADDER form realization of IIR filters 


% [y] = ladrfilt(K,C,x) 

y = output sequence 

4 K = LATTICE (reflection) coefficient array 
C = LADDER coefficient array 

x = input sequence 


Nx = length(x); y = zeros(1,Nx); 
N = length(C); f = zeros(N,Nx); g = zeros(N,Nx+1) ; 
f£(N,:) = x; 
for n = 2:1:Nx*1 
for m = N:-1:2 
f(m-1,n-1) = f(m,n-1) - K(n-1)*g(n-1,n-1); 
g(n,n) - K(m-1)*f(m-1,n-1) + g(m-1,n-1); 
end 
g(1,n) = £(1,n-1); 
end 
y = C*g(:,2:Nx+1); 


Convert the following pole-zero IIR filter into a lattice-ladder structure. 


1422 427? + z^? 


H(z) = 
(2) 14 2-1 + 82-2 + 32-8 


MATLAB Script —— —— ——————————————————— 
>> b = [1,2,2,1] a = [1, 13/24, 5/8, 1/3]; 
>> [K,C] = dir2ladrc(b) 

0.2500 0.5000 0.3333 


-0.2695 0.8281 1.4583 1.0000 


and 


Cy — —0.2695, C1 — 0.8281, C» — 1.4583, C3=1 


vse Vn SS E SS SSS i 
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PROBLEMS 


P6.1 A causal linear time-invariant system is described by 


win) - Y (1) ain 8) +92 (3) a-o 
f=1 


Determine and draw the block diagrams of the following structures. Compute the response 
of the system to 


a(n) =u(n), O<n< 100 


in each case using the corresponding structures. 
a. Direct form I 
b. Direct form II 
c. Cascade form containing second-order direct form II sections 
d. Parallel form containing second-order direct form II sections 
e. Lattice-ladder form 

P6.2 An HR filter is described by the following system function: 


H-2 1407427 2-z 14273427 
= ^11-—0.8z-1 + 0.642?  V1—0.7527! 1-4 0.8127? 


Determine and draw the following structures. 





FIGURE 6.23 IIR filter structures in Example 6.10: (a) Direct form (b) Lattice- 
ladder form 


a. Direct form I 
b. Direct form II 


c. Cascade form containing second-order direct form II sections 


The resulting direct form and the lattice-ladder form structures are shown in 
Figure 6.23. To check that our lattice-ladder structure is correct, let us compute 
the first 8 samples of its impulse response using both forms. 


d. Parallel form containing second-order direct form II sections 
e. Lattice-ladder form 
P6.3 An IIR filter is described by the following system function: 


es = -1 -1 
#2) = ( 14.75 — 12.9z ) (ee ) 


1-32-14 32°? 1-z-ic iz 


>> {x,n]=impseq(0,0,7) 
>> format long 
>> hdirect = filter(b,a,x) 
hdirect = 
Columns 1 through 4 
1.00000000000000 1.45833333333333 0.58506944444444 -0.56170428240741 
Columns 5 through 8 
-0.54752302758488 0.45261700163162 0.28426911049255 -0.25435705167494 
>> hladder = ladrfilt(K,C,x) 
hladder = 
Columns 1 through 4 
1.00000000000000 1.45833333333333 0.58506944444444 -0.56170428240741 
Columns 5 through 8 ; 
—0.54752302758488 0.45261700163162 0.28426911049255 -0.25435705167494 
(m) 


Determine and draw the following structures: 

a. Direct form I 

b. Direct form II 

c. Cascade form containing second-order direct form Il sections 
d. Parallel form containing second-order direct form II sections 
e. Lattice-ladder form 


P6.4 Figure 6.24 describes a causal linear time-invariant system. Determine and draw the 
following structures: 


Se et a Se See 
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FIGURE 6.24 Structure for Problem 6.4 


a. Direct form I 

b. Direct form IT 

c. Cascade form containing second-order direct form II sections 
d. Parallel form containing second-order direct form II sections 


P6.5 A linear time-invariant system with system function 


0.5(1+277)° 


Ne 
7 3,-1 4 27-2 185-3 _1,-4_ 112-54 77-6 
(1 32 1 $2 ie? 84 337 ° t 167 ) 


H(z) = 


„is to be implemented using a flowgraph of the form shown in Figure 6.25. 
a. Fill in all the coefficients in the diagram. 
b. Is your solution unique? Explain. 


P6.6 A linear time-invariant system with system function 


5411227 4 5442 ? — 0.384277 — 2.35522-* — 1.22882 5 


H(z) 140.82 1 — 0.5122-3 — 0.40962-4 


is to be implemented using a flowgraph of the form shown in Figure 6.26. Fill in all the 
coefficients in the diagram. 


P6.7 Consider the linear time-invariant system given in Problem 6.5. 


05 (14-271) 


He) = a 
(1 -izceiz?- 182-3 — 32-4 — Hz- 4 i2-9) 





FIGURE 6.25 Structure for Problem 6.5 
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y(n) 


FIGURE 6.26 Structure for Problem 6.6 


It is to be implemented using a flowgraph of the form shown in Figure 6.27. 
a. Fill in all the coefficients in the diagram. 
b. Is your solution unique? Explain. 

P6.8 An FIR filter is described by the difference equation 


10 


vin) = 0 (i) 20-8) 


k=0 

Determine and draw the block diagrams of the following structures. 
a. Direct form 

b. Linear-phase form 





FIGURE 6.27 Structure for Problem 6.7 
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P6.9 


P6.10 


P6.11 
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c. Cascade form 
d. Frequency sampling form 
A linear time-invariant system is given by the system function 


10 
H(z) = 9) 22)" 

k=0 
Determine and draw the block diagrams of the following structures. 
a. Direct form 
b. Cascade form 
c. Lattice form 
d. Frequency sampling form 
Using the conjugate symmetry property of the DFT 


_ fH (0, k=0 
80) - (550; kz1,..,M-1 


and the conjugate symmetry property of the W,,* factor, show that (6.12) can be put in 


the form (6.13) and (6.14) for real FIR filters. 


To avoid poles on the unit circle in the frequency sampling structure, one samples H (z) at 
zy = rei2"*/M, k —0,..., M — 1, where r © 1(but < 1) as discussed in this chapter. 
a. Using 


H (re??"*/^) ~ H (k) 


show that the frequency sampling structure is given by 


-M L 
H(z) = 1) — XLI Ot Ha 
k=1 


where 


cos [ZH (k)] — rz^! cos [ZH (k) — 24] 


Hx (z) = 
+ (2) 1 — 2rz-! cos (248) + z~? 


,k=1,...,0 
and M is even. 


b. Modify the MATLAB function dir2fs (which was developed in this chapter) to 
implement the above frequency sampling form. The format of this function should be 


[C,B,A,rM] = dir2fs(h,r) 
% Dixect form to Frequency Sampling form conversion 


% [C,B,A] = dir2fs(h) 

X C = Row vector containing gains for parallel sections 

% B = Matrix containing numerator coefficients arranged in rows 
% A = Matrix containing denominator coefficients arranged in rows 
% rM = r^M factor needed in the feedforward loop 
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% h = impulse response vector of an FIR filter 
X x = radius of the circle over which samples are taken (r<1) 
* 


c. Determine the frequency sampling structure for the impulse response given in Example 
6.6 using the above function. 


P6.12 Determine the impulse response of an FIR filter with lattice parameters 


Ko =2, Kı 2 0.6, K2 =0.3, Ka — 0.5, Ka = 0.9 


Draw the direct form and lattice form structures of the above filter. 





FIR FILTER DESIGN 


We now turn our attention to the inverse problem of designing systems 
from the given specifications. It is an important as well as a difficult prob- 
lem. In digital signal processing there are two important types of systems. 
The first type of systems perform signal filtering in the time domain and 
hence are called digital filters. The second type of systems provide signal 
representation in the frequency domain and are called spectrum analyzers. 
In Chapter 5 we described signal representations using the DFT. In this 
and the next chapter we will study several basic design algorithms for 
both FIR and IIR filters. These designs are mostly of the frequency selec- 
tive type; that is, we will design primarily multiband lowpass, highpass, 
bandpass, and bandstop filters. In FIR filter design we will also consider 
systems like differentiators or Hilbert transformers, which, although not 
frequency-selective filters, nevertheless follow the design techniques be- 
ing considered. More sophisticated filter designs are based on arbitrary 
frequency-domain specifications and require tools that are beyond the 
scope of this book. 

We first begin with some preliminary issues related to design philos- 
ophy and design specifications. These issues are applicable to both FIR 
and IIR filter designs. We will then study FIR filter design algorithms in 


the rest of this chapter. In Chapter 8 we will provide a similar treatment 
for IIR filters. 


PRELIMINARIES 


The design of a digital filter is carried out in three steps: 


e Specifications: Before we can design a filter, we must have some 
specifications. These specifications are determined by the applications. 

e Approximations: Once the specifications are defined, we use various 
concepts and mathematics that we studied so far to come up with a filter 
description that approximates the given set of specifications. This step is 
the topic of filter design. 


EXEC ED ctr EE EE RET 
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e Implementation: The product of the above step is a filter descrip- 
tion in the form of either a difference equation, or à system function H (z), 
or an impulse response h(n). From this description we implement the fil- 
ter in hardware or through software on a computer as we discussed in 
Chapter 6. 


In this and the next chapter we will discuss in detail only the second step, 
which is the conversion of specifications into a filter description. 

In many applications like speech or audio signal processing, digital 
filters are used to implement frequency-selective operations. Therefore, 
specifications are required in the frequency-domain in terms of the de- 
sired magnitude and phase response of the filter. Generally a linear phase 
response in the passband is desirable. In the case of FIR filters, it is pos- 
sible to have exact linear phase as we have seen in Chapter 6. In the case 
of IIR filters a linear phase in the passband is not achievable. Hence we 
will consider magnitude-only specifications. 

The magnitude specifications are given in one of two ways. The first 
approach is called absolute specifications, which provide a set of require- 
ments on the magnitude response function |H (e?^)]|. These specifications 
are generally used for FIR filters. IIR filters are specified in a somewhat 
different way, which we will discuss in Chapter 8. The second approach is 
called relative specifications, which provide requirements in decibels (dB), 
given by 


dB scale = —201o; Ie] 4 
scale — — Zio Go — 2 

10 [H (ef )| max 
This approach is the most popular one in practice and is used for both 
FIR and IIR filters. To illustrate these specifications, we will consider a 
lowpass filter design as an example. 


A typical absolute specification of a lowpass filter is shown in Figure 7.1a, 
in which 

e band [0, wp] is called the passband, and ô is the tolerance (or ripple) 
that we are willing to accept in the ideal passband response, 

e band [w,,7] is called the stopband, and 62 is the corresponding 
tolerance (or ripple), and 

e band [wp, ws] is called the transition band, and there are no restric- 
tions on the magnitude response in this band. 


A typical absolute specification of a lowpass filter is shown in Figure 7.1b, 
in which 

e Rp is the passband ripple in dB, and 

e. A, is the stopband attenuation in dB. 
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Passband 
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~ ripple 






\H(e/#)| 


, Transiti 





(a) 


Decibe!s 


(b) 
FIGURE 7.1 FIR filter specifications: (a) Absolute (b) Relative 


The parameters given in the above two specifications are obviously 
related. Since |H(e!”)|__ | in absolute specifications is equal to (1 + 61); 
we have 


= 1-4 " 
Rp = —-201ogio ith > 0 (20) (7.1) 
and 
= 62 
Ag = —20 logig ith >0(>1) (7.2) 


In a certain filter's specifications the passband ripple is 0.25 dB, and the stop- 
band attenuation is 50 dB. Determine 6: and 62. 


Using (7.1), we obtain 


1-6 
Rp = 0.25 = —20logjo CET => ô = 0.0144 


Using (7.2), we obtain 


n ê 
A, = 50 = —20l0g10 7 = & T oto 1x0004 





=> 6; = 0.0032 oO 


Given the passband tolerance 6, = 0.01 and the stopband tolerance 62 = 0.001, 
determine the passband ripple Rp and the stopband attenuation Aa. 
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Solution From (7.1) the passband ripple is 


1-6 
= —201 = 0.1737 dB 
Rp OS 10 l5 





and from (7.2) the stopband attenuation is 


62 


A, = —20logio 144 


= 60 dB o 





The above specifications were given for a lowpass filter. Similar spec- 
ifications can also be given for other types of frequency-selective filters, 
such as highpass or bandpass. However, the most important design param- 
eters are frequency-band tolerances (or ripples) and band-edge frequencies. 
Whether the given band is a passband or a stopband is a relatively minor 
issue. Therefore in describing design techniques, we will concentrate on a 
lowpass filter. In the next chapter we will discuss how to transform a low- 
pass filter into other types of frequency-selective filters. Hence it makes 
more sense to develop techniques for a lowpass filter so that we can com- 
pare these techniques. However, we will also provide examples of other 
types of filters. In light of this discussion our design goal is the following. 


Problem Statement Design a lowpass filter (i.e., obtain its system 
function H(z) or its difference equation) that has a passband [0, wp] with 
tolerance 6, (or Rp in dB) and a stopband [w,, 7] with tolerance 69 (or 
A, in dB). 

In this chapter we turn our attention to the design and approximation 
of FIR digital filters. These filters have several design and implementa- 
tional advantages: 


e The phase response can be exactly linear. 

e They are relatively easy to design since there are no stability prob- 
lems. 

e They are efficient to implement. 

e The DFT can be used in their implementation. 


As we discussed in Chapter 6, we are generally interested in linear- 
phase frequency-selective FIR filters. Advantages of a linear-phase re- 
sponse are: 


e design problem contains only real arithmetic and not complex arith- 
metic; 

e linear-phase filters provide no delay distortion and only a fixed 
amount of delay; 

e for the filter of length M (or order M — 1) the number of opera- 
tions are of the order of M/2 as we discussed in the linear-phase filter 
implementation. 


We first begin with a discussion of the properties of the linear-phase 
FIR filters, which are required in design algorithms. Then we will discuss 
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three design techniques, namely the window design, the frequency sam- 
pling design, and the optimal equiripple design techniques for linear-phase 
FIR filters. 


PROPERTIES OF LINEAR-PHASE FIR FILTERS 
_ — —W—— 


In this section we discuss shapes of impulse and frequency responses and 
locations of system function zeros of linear-phase FIR filters. Let h(n), 
0 € n € M — 1 be the impulse response of length (or duration) M. Then 
the system function is 


M-1 M-1 
H(z)= py h(n)z" = z (M-) »» h(nyzM- 17" 

n=0 n=0 
which has (M — 1) poles at the origin z = 0 (trivial poles) and (M — 1) 
zeros located anywhere in the z-plane. The frequency response function 
is 

H M1 - 

H(e") = P$ h(n)e ?"", —-r«wt&m 


n=0 


Now we will discuss specific requirements on the forms of h(n) and H(e/") 
as well as requirements on the specific locations of (M — 1) zeros that the 
linear-phase constraint imposes. 


IMPULSE We impose a linear-phase constraint 


RESPONSE l 
k(n) LH(e) = ~aw, -n <w LT 


where a is a constant phase delay. Then we know from Chapter 6 that 
h(n) must be symmetric, that is, 


-1 





h(n)  M-1-n, 0<n<(M—1) with a= * (13) 


Hence h(n) is symmetric about a, which is the index of symmetry. There 
are two possible types of symmetry: 


e M odd: In this case a = (M — 1)/2 is an integer. The impulse 
response is as shown below. 
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e M even: In this case a = (M — 1)/2 is not an integer. The impulse 
response is as shown below. 


Symmetric Impulse Response: M even 





h(n) 





We also have a second type of “linear-phase” FIR filter if we require 
that the phase response / H (e/") satisfy the condition 


LH(e") = 8 — ow 


which is a straight line but not through the origin. In this case a is not a 
constant phase delay, but 


dLH(e"^) | NN 

= 
is constant, which is the group delay. Therefore a is called a constant 
group delay. In this case, as a group, frequencies are delayed at a constant 


rate. But some frequencies may get delayed more and others delayed less. 
For this type of linear phase one can show that 


h(n) = -h(M —1- n), 0«nz(M-1:ac 75 8-25 (7.4) 
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RESPONSE 
H(e") 


This means that the impulse response h(n) is antisymmetric. The index 
of symmetry is still œ = (M — 1)/2. Once again we have two possible 
types, one for M odd and one for M even. 


e M odd: In this case a = (M — 1)/2 is an integer and the impulse 
response is as shown below. 


Antisymmetric Impulse Response: M odd 
rn amas) 
$ 
— 


Tae 
0 (M-1y2 
n 








go NE 








Note that the sample h(a) at a = (M — 1)/2 must necessarily be equal 
to zero, i.e., h((M — 1)/2) = 0. 

e M even: In this case a = (M — 1)/2 is not an integer and the 
impulse response is as shown below. 


Antisymmetric Impulse Response: M even 


T —T 











When the cases of symmetry and antisymmetry are combined with odd 
and even M, we obtain four types of linear-phase FIR filters. Frequency 
response functions for each of these types have some peculiar expressions 
and shapes. To study these responses, we write H (e) as 


M-1 
2 





H(e") zz H, (w); p= t2 a= (7.5) 


EN $$ 
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where H,(w) is an amplitude response function and not a magnitude re- 
sponse function. The amplitude response is a real function, but unlike 
the magnitude response, which is always positive, the amplitude response 
may be both positive and negative. The phase response associated with 
the magnitude response is a discontinuous function, while that associated 
with the amplitude response is a continuous linear function. To illustrate 
the difference between these two types of responses, consider the following 
example. 


Let the impulse response be h(n) = {1,1,1}. Determine and draw frequency 
T 


responses. 


The frequency response function is 


2 
H(e*) = >> h(n)e"" = 1-4 1677" eI = fe +140} e" 
o 


= {1 + 2c0osw} e?" 
From this the magnitude and the phase responses are 
|H(e™)| =|1+2coswi|, O<wer 


j = 0 « w « 2r/3 
LH (e =) = nid / 

n-w, 2n/3«w«m 
since cosw can be both positive and negative. In this case the phase response 
is piecewise linear. On the other hand, the amplitude and the corresponding 
phase responses are 


H,(w) = 1+ 2cosw, 


5 -TLWIT 

LH (e) = w, 
In this case the phase response is truly linear. These responses are shown in Fig- 
ure 7.2. From this example the difference between the magnitude and the am- 
plitude (or between the piecewise linear and the linear-phase) responses should 
be clear. 


Type-1 linear-phase FIR filter: Symmetrical impulse response, 
M odd 1n this case f = 0, œ = (M — 1)/2 is an integer, and h(n) = 
h(M—1-n) 0 <n <M -—1. Then we can show (see Problem 7.1) that 


(M-1)/2 
H(e”) = » a(n) cos un e 0 (M-0/2 (7.6) 


n=0 
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FIGURE 7.2 Frequency responses in Example 7.3 


where sequence a(n) is obtained from h(n) as 


a(0) — (>) : the middle sample 








2 
" M (7.7) 
a(n) = 2h ( a -n), l<n< = 
Comparing (7.5) with (7.6), we have 
(M-1)/2 
H,(w) = > a(n) coswn (7.8) 
n=0 


Type-2 linear-phase FIR filter: Symmetrical impulse response, 
M even Inthiscaseagain§ = 0 , h(n) = h(M—1-n), 0<n<M-l, 
but a = (M —1)/2 is not an integer. Then we can show (see Problem 7.2) 
that 


M/2 


H(i) = [x b(n) cos e E 5) Y gj 0-0/2 — (r9) 
n=l 
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where 


iin) e 2 (3-2), meee (7.10) 


Hence 


M/2 


H,(w) = = b(n) cos fo (s - )} (7.11) 


Note: At w = vx we get 


M/2 


H,(x) = Y b(n) cos { (s- ;)] =0 


n=1 


regardless of b(n) or h(n). Hence we cannot use this type (i.e., symmetric 
h(n), M even) for highpass or bandstop filters. 


Type-3 linear-phase FIR filter: Antisymmetric impulse re- 
sponse, M odd In this case 8 = 7/2, a = (M — 1)/2 is an integer, 
h(n) = -h(M -1—n), 0 Xn <M- 1, and &((M — 1)/2) = 0. Then 
we can show (see Problem 7.3) that 


(M-1)/2 
H(e”) = | E» d ell F- (4 )4] (7.12) 


n= 


where 
e(n) = 2h (=> z n) asig Secr qad 
2 2 
and 
(M—1)/2 
H,(w) = X c(n)sinwn (7.14) 
n=1 


Note: At w = 0 and w = x we have H,(w) = 0, regardless of c(n) or 
h(n). Furthermore, e/*/? = j, which means that jH,(w) is purely imagi- 
nary. Hence this type of filter is not suitable for designing a lowpass filter 
or a highpass filter. However, this behavior is suitable for approximat- 
ing ideal digital Hilbert transformers and differentiators. An ideal Hilbert 
transformer [19] is an all-pass filter that imparts a 90° phase shift on the 
input signal. It is frequently used in communication systems for modula- 
tion purposes. Differentiators are used in many analog and digital systems 
to take the derivative of a signal. 
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Type-4 linear-phase FIR filter: Antisymmetric impulse re- 
sponse, M even This case is similar to Type-2. We have (see Problem 


7.4) 
H(e^) = Yam sin fo ( - ;)] eil -(M-0/2 (7.15) 
where 
ain) em (S -n), nly (7.16) 
and 
H,(w) = Yun sin fo (r - 5) \ (7.17) 


Note: At w = 0, H,(0) = 0 and e/"/? = j. Hence this type is also 
suitable for designing digital Hilbert transformers and differentiators. 


MATLAB The MATLAB routine freqz computes the frequency response but we can- 
IMPLEMEN- not determine the amplitude response from it because there is no function 
TATION in MATLAB comparable to the abs function that can find amplitude. How- 


ever, it easy to write simple routines to compute amplitude responses for 
each of the four types. We provide four functions to do this. 


1. Hr.typeti: 


function [Hr,w,a,L] = Hr Typei(h); 
% Computes Amplitude response Hr(w) of a Type-1 LP FIR filter 


% [DHr,w,a,L] = Hr_Typei(h) 

% Hr = Amplitude Response 
w = 500 frequencies between [0 pi] over which Hr is computed 
a = Type-1 LP filter coefficients 

% L = Order of Hr 
h = Type-1 LP filter impulse response 


M = length(h); 

L = (M-1)/2; 

a = [h(L+1) 2*h(L:-1:1)]; % 1x(L*1) row vector 

n= [0:1:L]; % (L+1)x1 column vector 

w = [0:1:500] ’*pi/500; 

Hr = cos(w*n)*a’ ; 
MÀ 
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2. Hr.type2: 


function [Hr,v,b,L] = Hr_Type2(h); 

% Computes Amplitude response of a Type-2 LP FIR filter 
pQ——————— nnn renner 

X [Hr,w,b,L] = Hr_Type2(h) 

% Hr = Amplitude Response 

* frequencies between [0 pi] over which Hr is computed 
Type-2 LP filter coefficients 

Order of Hr 

Type-2 LP impulse response 


zx 
motu 
uou ow 


length(h); 

M/2; 

2*[h(L:-1:1)]; 
(1:1:L]; n = n-0.5; 
[0:1:500] ’*pi/500; 
cos(w*n) *b' ; 


3. Hr_type3: 


function [Hr,w,c,L] = Hr Type3(h); 
% Computes Amplitude response Hr(w) of a Type-3 LP FIR filter 


% [Hr,v,c,L] = Hr_Type3(h) 

% Hr = Amplitude Response 

= frequencies between [0 pi] over which Hr is computed 
= Type-3 LP filter coefficients 

= Order of Hr 

= Type-3 LP impulse response 


= 
rros 


length(h); 
(M-1)/2; 
[2+h(L+1:-1:1)]; 
[0:1:L]; 

[0:1:500] ’*pi/500; 
sin(w*n)*c!; 


Faepors 
anton n9 


4. Hr_type4: 


function [Hr,w,d,L] = Hr_Type4(h); 

% Computes Amplitude response of a Type-4 LP FIR filter 

Y% wenn en nnn nnn nnn nnn nnn ae 

% [Hr,w,d,L] = Hr_Type4(h) 

% Hr = Amplitude Response 

% w= frequencies between [0 pi] over which Hr is computed 
% d= Type-4 LP filter coefficients 

% L = Order of d 

% h = Type-4 LP impulse response 
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length(h); 

M/2; 

2*[n(L:-71:1)]; 
[1:1:1]; n = n-0.5; 
[0:1:500] ^*pi/500; 
sin(w*n) *d’ ; 


F enara 
uU H Wü W M Uu 


These four functions can be combined into one function. This function 
can be written to determine the type of the linear-phase filter and to im- 
plement the appropriate amplitude response expression. This is explored 
in Problem 7.5. The use of these functions is described in Examples 7.4 
through 7.7. 


Recall that for an FIR filter there are (M — 1) (trivial) poles at the origin 
and (M — 1) zeros located somewhere in the z-plane. For linear-phase 
FIR filters, these zeros possess certain symmetries that are due to the 
symmetry constraints on h(n). It can be shown (see [19] and Problem 
7.6) that if H(z) has a zero at 


z-z-re 
then for linear phase there must be a zero at 
z=} =le 


21 T 


For a real-valued filter we also know that if zı is complex, then there must 
be a conjugate zero at zj — re^J9, which implies that there must be a 
zero at 1/zt = (1/r) e/?. Thus a general zero constellation is a quadruplet 


i ii - 1.5 
re?, Le, re^? and ze je 
T 


as shown in Figure 7.3. Clearly, if r = 1, then l/r — 1, and hence the 
zeros are on the unit circle and occur in pairs 


ei? and ej? 
If 0 — 0 or 0 = m, then the zeros are on the real line and occur in pairs 
1 
T and - 
T 


Finally, if r = 1 and 8 = 0 or 6 = m, the zeros are either at z — l or 
z = —1. These symmetries can be used to implement cascade forms with 
linear-phase sections. 


A MM 
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o EXAMPLE 7.4 


Pole-Zero Plot 





—T———T — 7T 


z-plane 








imaginary axis- 





-1.5 -1 05 0 0.5 1 15 
real axis 


FIGURE 7.3 A general zero constellation 


In the following examples we illustrate the above described properties 
of linear-phase FIR filters. 


Let h(n) = (—4,1,—1, -2,5,6,5, —2, —1,1, —4). Determine the amplitude re- 
T 


sponse H, (w) and the locations of the zeros of H (z). 


Solution Since M = 11, which is odd, and since h(n) is symmetric about a = (11-1)/2 = 
5, this is a Type-1 linear-phase FIR filter. From (7.7) we have 
a(0) = h(a) = h(5)=6, a(l) = 2h(5 — 1)=10, a(2) = 2h(5 — 2) = —4 
a(3) = 2h(5-3)=-2, a(4)= 2h(5—4)=2, a(5)=2h(5 - 5) = —8 
From (7.8), we obtain 
H, (w) = a(0) + a(1) cosw + a(2) cos 2w + a(3) cos 3w + a(4) cos 4w + a(5) cos 5w 
= 6 + 10cosuw — 4 cos 2w — 2 cos 3w + 2 cos 4w — 8 cos 5w 
MATLAB Script ——————— 
>> h = [-4,1,-1,-2,5,6,5,-2,-1,1,74]; 
>> M = length(h); n = 0:M-1; 
>> [Hr,w,a,L] = Hr Typei(h); 
M ————ÓW 
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>> a,L 

a=6 10 -4 -2 2 -8 

L=5 

>> amax = max(a)*i; amin = min(a)-1; 

>> subplot(2,2,1); stem(n,h); axis([-1 2*L*1 amin amax]) 
>> xlabel(’n’); ylabel(’h(n)’); title(’ Impulse Response!) 
>> subplot(2,2,3); stem(0:L,a); axis([-1 2*L+1 amin amax]) 
>> xlabel(’n’); ylabel(’a(n)’); title(’a(n) coefficients’) 
>> subplot(2,2,2); plot(w/pi,Hr);grid 

>> xlabel(’frequency in pi units’); ylabel('Hr?) 

>> title(’Type-1 Amplitude Response’) 

>> subplot(2,2,4); pzplotz(h,1) 


ag 


The plots and the zero locations are shown in Figure 7.4. From these plots we 
observe that there are no restrictions on H, (w) either at w = 0 or at w = m. 
There is one zero-quadruplet constellation and three zero pairs. o 


Let h(n) = (—4,1, —1, —2, 5,6,6,5, —2, —1,1, —4). Determine the amplitude 
T 


response H, (w) and the locations of the zeros of H (z). 
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FIGURE 7.4 Plots in Example 7.4 
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This is a Type-2 linear-phase FIR filter since M = 12 and since h(n) is sym- 
metric with respect to a = (12 — 1) /2 = 5.5. From (7.10) we have 


b(1) = 2h (#2 —1)=12, 6(2) = 2h (42-2) =10, 0(3) = 2h (3 —3) =-4 
b(4) = 2h (22 -4) =-2, B5) 2h (2 -5)-2, (8) = 2h (#2 — 6) =-8 
Hence from (7.11) we obtain 
H, (w) = b(1) cos [w (1 — 3)] +002) eos [w (2 - 4)] + (8) eos [o (3 - 4)] 
+ &(4) cos [w (4 — 2)] + (5) cos [w (5 — 3)] + (6) cos [w (6 - 3)] 


= ireas (2) ten (82) ~ te ($2) -2em (28) 


9w lliw 
+2cos (=) — 8cos (=) 


MATLAB Script ——— 
> h= [-4,1,-1,-2,5,6,6,5,-2,-1,1,-4]; 

>> M = length(h); n = 0:M-1; 

>> [Hr,w,a,L] = Hr_Type2(h); 

>> bL 

b= 12 10 -4 -2 2 -8 

L=6 

>> bmax = max(b)*i; bmin = min(b)-1; 

»» subplot(2,2,1); stem(n,h); axis([-1 2*L*1 bmin bmax]) 
>> xlabel(’n’); ylabel(^h(n)); title('Impulse Response’) 
>> subplot (2,2,3); stem(1:L,b); axis([-1 2*L*1 bmin bmax]) 
>> xlabel(’n’); ylabel(’b(n)’); title(’b(n) coefficients’) 
>> subplot (2,2,2); plot (w/pi,Hr) ;grid 

>> xlabel(’frequency in pi units’); ylabelC Hr?) 

>> title('Type-1 Amplitude Response’ ) 

>> subplot(2,2,4); pzplotz(h, 1) 


The plots and the zero locations are shown in Figure 7.5. From these plots we 
observe that H, (w) is zero at w = v. There is one zero-quadruplet constellation, 
three zero pairs, and one zero at w = 7 as expected. ü 


ü EXAMPLE 7.6 Let h(n) = (—4,1, 1, -2, 5,0, —5, 2, 1, —1, 4}. Determine the amplitude re- 
1 
sponse H, (w) and the locations of the zeros of H (z). 
Solution Since M = 11, which is odd, and since h(n) is antisymmetric about a = 
(11 — 1)/2 = 5, this is a Type-3 linear-phase FIR filter. From (7.13) we have 
(0) = h(a) = h(5) 20, c(1)=2A(5-1)=10, (2) = 2h(2—2) = —4 
c(3)-2h(5—3)- —2, (4) =2h(5-4)=2, (5) = 2h(5-5) =-8 
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FIGURE 7.5 Plots in Example 7.5 





From (7.14) we obtain 


H,(w) = c(0) + c(1) sino + c(2) sin 2w + c(3) sin 3w + c(4) sin 4 + c(5) sin 5w 
— 0 + 10sinw — 4sin 2w — 2sin 3w + 2sin 4w — 8sin 5w 


MATLAB Script 1 LL À————————————————— 
> h= [-4,1,-1,-2,5,0,-5,2,1,-1,4]; 

>> M = length(h); n = 0:M-1; 

>> [Hr,w,c,L] = Hr_Type3(h); 

>> c,L 

a0 10 -4 -2 2 -8 

L=5 

>> cmax = max(c)*i; cmin = min(c)-1; 

>> subplot (2,2,1); stem(n,h); axis((-1 2*L*1 cmin cmax]) 
>> xlabel('n?); ylabel(*h(n)’); title(’Impulse Response’) 
>> subplot (2,2,3); stem(0:L,c); axis([-1 2*L+1 cmin cmax]) 
>> xlabel(’n’); ylabel(’c(n)’); title(’c(n) coefficients’) 
>> subplot (2,2,2); plot(w/pi,Hr);grid 

>> xlabel(’ frequency in pi units’); ylabel( Hr?) 

>> title(’Type-1 Amplitude Response’) 

>> subplot (2,2,4); pzplotz(h,1) 


A e —M————M——MÉÉu 
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The plots and the zero locations are shown in Figure 7.6. From these plots we 
observe that H, (w) = 0 at w = 0 and at w = m. There is one zero-quadruplet 
constellation, two zero pairs, and zeros at w = 0 and w = m as expected. a 


o EXAMPLE 77 Let h(n) = (—4,1,—1,—2,5,6, —6, —5, 2,1,—1,4}. Determine the amplitude 
t 
response H, (w) and the locations of the zeros of H (z). 


Solution This is a Type-4 linear-phase FIR filter since M = 12 and since h (n) is anti- 
symmetric with respect to a = (12 — 1) /2 = 5.5. From (7.16) we have 


d()-2&(2-1)-12, d(2)=2h(} -2)=10, 4(3) = 2h (#2 — 3) = —4 
d(4) = 2h (2 - 4) = —2, d(5) =2h(#2-5)=2, (6) =2h(? -6)=-8 
Hence from (7.17) we obtain 


H,(w) = d(1) sin |w (a E 3) + d(2) sin lo (2 = 7) +4(3) sin[u (3 * 3) 
+ d(4) sin |w (4 = 5) + d(5) sin [e (s E 3) + d(6) sin (s = 3 
= 12sin(=) + 10sin( =) - Asin (S) - asin() 


. [9w , {11w 
+ 2sin( 32) - 8sin( 2 ) 
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FIGURE 7.6 Plots in Example 7.6 
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MATLAB Script. —————————————————————————— 
>» h= (-4,1,-1,-2,5,6,-6,-5,2,1,-1,4]; 

>> M = length(h); n = 0:M-1; 

>> [Hr,w,d,L] = Hr Type4(b); 


>> b,L 
d = 12 10 -4 -2 2 -8 
L=6 


>> dmax = max(d)+1; dmin = min(d)-1; 

>> subplot (2,2,1); stem(n,h); axis([-1 2*L*1 dmin dmax]) 
>> xlabel(’n’); ylabel(*h(n)’); title(’ Impulse Response’) 
>> subplot (2,2,3); stem(1:L,d); axis([-1 2*L*1 dmin dmax]) 
>> xlabel('n?); ylabel('d(n)"); titleC d(n) coefficients!) 
»» subplot(2,2,2); plot (v/pi,Hr);grid 

»» xlabel('frequency in pi units"); ylabel (’Hr’) 

>> title('Type-1 Amplitude Response!) 

»» subplot(2,2,4); pzplotz(h,1) 


v 


The plots and the zero locations are shown in Figure 7.7. From these plots we 
observe that H» (w) is zero at w = 0. There is one zero-quadruplet constellation, 





three zero pairs, and one zero at w = 0 as expected. D 
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FIGURE 7.7 Plots in Example 7.7 
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WINDOW DESIGN TECHNIQUES 
—— m 


The basic idea behind the window design is to choose a proper ideal 
frequency-selective filter (which always has a noncausal, infinite-duration 
impulse response) and then truncate (or window) its impulse response 
to obtain a linear-phase and causal FIR filter. Therefore the emphasis 
in this method is on selecting an appropriate windowing function and 
an appropriate ideal filter. We will denote an ideal frequency-selective 
filter by H,(e/*), which has a unity magnitude gain and linear-phase 
characteristics over its passband, and zero response over its stopband. An 
ideal LPF of bandwidth w, < 7 is given by 


1- ei, lwl Swe 


1.18 
0, We «lw Ev (7.18) 


Hale”) = { 


where we is also called the cutoff frequency, and a is called the sample 
delay (note that from the DTFT properties, e^)?" implies shift in the 
positive n direction or delay). The impulse response of this filter is of 
infinite duration and is given by 


ha(n) =F [Ha] = go [ Hao (19) 


aL emendo 
22 


€ 


_ sinjwe(n-a)] 
^. a(n-a) 


Note that hg(n) is symmetric with respect to a, a fact useful for linear- 
phase FIR filters. 

To obtain an FIR filter from h4(n), one has to truncate ha(n) on both 
sides. To obtain a causal and linear-phase FIR filter h(n) of length M, we 
must have 


h(n) = ha(n), O<n<M-1 M - 
m=) o, elsewhere 2 


= 





(7.20) 


This operation is called “windowing.” In general, h(n) can be thought of 
as being formed by the product of ha(n) and a window function w(n) as 
follows: 


h(n) = ha(n)w(n) (7.21) 


VT 
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where 


some symmetric function with respect to 
w(n) = aoverO0<n<M-1 


0, otherwise 


Depending on how we define w(n) above, we obtain different window 
designs. For example, in (7.20) above 


w(n) = { 


1, O<n<M-1 
otherwise 


= Re (n) 


which is the rectangular window defined earlier. 
In the frequency domain the causal FIR filter response H (e/") is given 
by the periodic convolution of Ha(e/") and the window response W (e/"); 


that is, 


H(e”) = Hale”) © We) = E f W (e?) Ha (ee) dd 


(7.22) 


This is shown pictorially in Figure 7.8 for a typical window response, from 
which we have the following observations: 


1. Since the window w(n) has a finite length equal to M, its response 
has a peaky main lobe whose width is proportional to 1/M, and has side 


lobes of smaller heights. 


Hy ( el) 
w 
=m I7 0 Oc T 
Wie!) 
Max side-lobe 
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o 
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FIGURE 7.8 Windowing operation in the frequency domain 
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RECTANGULAR 
WINDOW 





2. The periodic convolution (7.22) produces a smeared version of the 
ideal response Ha(e"). 

3. The main lobe produces a transition band in H(e™) whose width 
is responsible for the transition width. This width is then proportional to 
1/M. The wider the main lobe, the wider will be the transition width. 

4. The side lobes produce ripples that have similar shapes in both 
the passband and stopband. 


Basic Window Design Idea For the given filter specifications choose 
the filter length M and a window function w(n) for the narrowest main 
lobe width and the smallest side lobe attenuation possible. 

From observation 4 above we note that the passband tolerance 6, and 
the stopband tolerance 62 cannot be specified independently. We generally 
take care of 59 alone, which results in 62 = 61. We now briefly describe 
various well-known window functions. We will use the rectangular window 
as an example to study their performances in the frequency domain. 


This is the simplest window function but provides the worst performance 
from the viewpoint of stopband attenuation. It was defined earlier by 


1, 0<n<M-1 
umns B otherwise (7.23) 


Its frequency response function is 


ee sin (2M) ajo Mz _ sin (M4) 
ven Emmy 


which is the amplitude response. From (7.22) the actual amplitude re- 
sponse H, (w) is given by 


wwe Wwe 


1 1 in (2M 
H, (w) = = J W.Q)dA- z- f Y M»1 (7.24) 
iv 2 


=e. 


This implies that the running integral of the window amplitude response 
(or accumulated amplitude response) is necessary in the accurate anal- 
ysis of the transition bandwidth and the stopband attenuation. Figure 
7.9 shows the rectangular window function w (n), its amplitude response 
W (w), the amplitude response in dB, and the accumulated amplitude 
response (7.24) in dB. From the observation of plots in Figure 7.9 we can 
make several observations. 


I ne 
245 


Window Design Techniques 


Amplitude Response in dB 





frequency in pi units 








0 1 
frequency in pi units frequency in pi units 


FIGURE 7.9 Rectangular window: M = 45 


1. The amplitude response W, (w) has the first zero at w = v, where 


wM e T o = a 
2 1 M 
Hence the width of the main lobe is 2w, = 47/M. Therefore the approzi- 
mate transition bandwidth is 4n /M. 
2. The magnitude of the first side lobe (which is also the peak side 
lobe magnitude) is approximately at w = 37/M and is given by 


_3n sin (3) 
w (v= m)l lame) 


Comparing this with the main lobe amplitude, which is equal to M, the 
peak side lobe magnitude is 


2 
nd for M>1 
31 

















2 = 21.22% = 13 dB 
3r 


of the main lobe amplitude. 

3. The accumulated amplitude response has the first side lobe mag- 
nitude at 21 dB. This results in the minimum stopband attenuation of 21 
dB irrespective of the window length M. 


MM AGES LESEN 
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4. Using the minimum stopband attenuation, the transition band- 
width can be accurately computed. It is shown in the accumulated 
amplitude response plot in Figure 7.9. This computed ezact transition 
bandwidth is 
1.87 

M 
which is about half the approximate bandwidth of 47 /M. 


Ws — Wp = 


Clearly, this is a simple window operation in the time domain and 
an easy function to analyze in the frequency domain. However, there are 
two main problems. First, the minimum stopband attenuation of 21 dB is 
insufficient in practical applications. Second, the rectangular windowing 
being a direct truncation of the infinite length ha (n), it suffers from the 
Gibbs phenomenon. If we increase M, the width of each side lobe will 
decrease, but the area under each lobe will remain constant. Therefore the 
relative amplitudes of side lobes will remain constant, and the minimum 
stopband attenuation will remain at 21 dB. This implies that all ripples 
will bunch up near the band edges. It is shown in Figure 7.10. 

Since the rectangular window is impractical in many applications, we 
consider other window functions, many of which bear the names of the 
people who first proposed them. Although these window functions can 
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FIGURE 7.10 Gibbs phenomenon 
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also be analyzed similar to the rectangular window, we present only their 
results. 


BARTLETT Since the Gibbs phenomenon results from the fact that the rectangular 
WINDOW window has a sudden transition from 0 to 1 (or 1 to 0), Bartlett suggested 
a more gradual transition in the form of a triangular window, which is 
given by 
2n M-1 
<n< 
m-r 450353 
w(n) = 2n —-1 <n< ci (7.25) 
Moro SM 


0, otherwise 








ES 








This window and its frequency-domain responses are shown in Figure 
7.11. 


Triangular Window : M=45 Amplitude Response in dB 


w(n) 











frequency in pi units frequency in pi units 
FIGURE 7.11 Bartlett (triangular) window: M = 45 
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HANNING 
WINDOW 


HAMMING 
WINDOW 











Hanning Window : M=45 Amplitude Response in dB 
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FIGURE 7.12 Hanning window: M = 45 


This is a raised cosine window function given by 


save e | — cos ($5) , O<n<M-1 (7.26) 


0, otherwise 





This window and its frequency-domain responses are shown in Figure 
7.12. 


This window is similar to the Hanning window except that it has a small 
amount of discontinuity and is given by, 


(7.27) 


= 2an = 
win) = {054 0.46 cos (5), OSn<M-1 
0, otherwise 


This window and its frequency-domain responses are shown in Figure 
7.13. 


NN ra 
249 


Window Design Techniques 


BLACKMAN 
WINDOW 


KAISER 
WINDOW 


Hamming Window : M=45 Amplitude Response in dB 
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22 
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FIGURE 7.13 Hamming window: M = 45 


This window is also similar to the previous two but contains a second 
harmonic term and is given by 





0.42 — 0.5 cos ( 28% ) + 0.08 cos (ie), 0<nsM-1 


otherwise 


w(n) = 


(7.28) 


This window and its frequency-domain responses are shown in Figure 
7.14. 

In Table 7.1 we provide a summary of window function characteristics 
in terms of their transition widths (as a function of M) and their minimum 
stopband attenuations in dB. Both the approximate as well as the exact 
transition bandwidths are given. Note that the transition widths and the 
stopband attenuations increase as we go down the table. The Hamming 
window appears to be the best choice for many applications. 


This is one of the most useful and optimum windows. It is optimum in 
the sense of providing a large main lobe width for the given stopband 
attenuation, which implies the sharpest transition width. The window 
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win) 
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Amplitude Response in dB 








FIGURE 7.14 Blackman window: M = 45 
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frequency in pi units 


Accumulated Amplitude Response 


idth-(11)"* 


TABLE 7.1 Summary of commonly used window function characteristics 
a 


Window 
Name 


Rectangular 


Bartlett 


Hanning 


Hamming 


Blackman 


a 


Transition Width Aw 


Approzimate 
án 
M 
8r 
M 
8r 
M 
8r 
M 


127 
M 


Exact Values 


1.87 


Min. Stopband 
Attenuation 


21 dB 
25dB 


44 dB 
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function is due to J. F. Kaiser and is given by 


w(n) = , O<n<M-l (7.29) 





where To [.] is the modified zero-order Bessel function, and ĝ is a parame- 
ter that depends on M and that can be chosen to yield various transition 
widths and near-optimum stopband attenuation. This window can pro- 
vide different transition widths for the same M, which is something other 
windows lack. For example, 


e if 8 = 5.658, then the transition width is equal to 7.87 /M, and the 
minimum stopband attenuation is equal to 60 dB. This is shown in Figure 
7.15. 

e if  — 4.538, then the transition width is equal to 5.81/M, and the 
minimum stopband attenuation is equal to 50 dB. 


Hence the performance of this window is comparable to that of the Ham- 
ming window. In addition, the Kaiser window provides flexible transi- 
tion bandwidths. Due to the complexity involved in the Bessel functions, 
the design equations for this window are not easy to derive. Fortunately, 


Kaiser Window : M=45 Amplitude Response in dB 


w(n) 





0 
frequency in pi units 
Accumulated Amplitude Response 
.; Width (7.8)"pi 











0 22 45 - 1 
frequency in pi units frequency in pi units 


FIGURE 7.15 Kaiser window: M = 45, B = 5.658 
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DESIGN 
EQUATIONS 


MATLAB 
IMPLEMEN- 
TATION 


Kaiser has developed empirical design equations, which we provide below 
without proof. 


Given wp, Ws, Hp, and A, 


Norm. transition width = Af Ê “oe 
A, — 7.95 
Filter order M ~ 1436Af +1 (7.30) 
0.1102 (A, — 8.7), A, 2: 50 


Parameter Ê = 4 0,5842 (A, — 21) * 
-L0.07886 (As — 21), 21< A, < 50 


MATLAB provides several routines to implement window functions dis- 
cussed in this section. A brief description of these routines is given below. 


e w=boxcar(M) returns the M-point rectangular window function in 
array w. 

e wstriang(M) returns the M-point Bartlett (triangular) window 
function in array wW. 

e w-hanning(M) returns the M-point Hanning window function in ar- 
ray w. 

e w-hamming(M) returns the M-point Hamming window function in 
array w. 

e w-blackman(M) returns the M-point Blackman window function in 
array w. 

e w-kaiser(M,beta) returns the beta-valued M-point rectangular 
window function in array w. 


Using these routines, we can use MATLAB to design FIR filters based 
on the window technique, which also requires an ideal lowpass impulse 
response ha(n). Therefore it is convenient to have a simple routine that 
creates hg(n) as shown below. ; 


function hd = ideal lp(wc,M); 
X4 Ideal LowPass filter computation 


% [hd] = ideal lp(wc,M) 

% hd = ideal impulse response between 0 to M-1 
% wc = cutoff frequency in radians 

% M= length of the ideal filter 


1 
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alpha = (M-1)/2; 

n = [0:1: (4-251; 

m=n - alpha + eps; 

hd = sin(wc*m) ./ (pi*m; 


DESIGN 
EXAMPLES 


0 EXAMPLE 7.8 


Solution 


% add smallest number to avoid divide by zero 


In the Signal Processing toolbox MATLAB provides a routine called firi, 
which designs FIR filters using windows. However, this routine is not 
available in the Student Edition. To display the frequency-domain plots 
of digital filters, MATLAB provides the freqz routine, which we used in 
earlier chapters. Using this routine, we have developed a modified version, 
called freqz.m, which returns the magnitude response in absolute as well 
as in relative dB scale, the phase response, and the group delay response. 
We will need the group delay response in the next chapter. 


function [db,mag,pha,grd,w] = freqz m(b,a); 

% Modified version of freqz subroutine 

Y wenn anna nanan nnn nena nnn nnn nnn mannan 

% [db,mag,pha,grd,w) = freqz_m(b,a); 

% db = Relative magnitude in dB computed over 0 to pi radians 
% mag = absolute magnitude computed over 0 to pi radians 

% pha = Phase response in radians over 0 to pi radians 


% grd = Group delay over 0 to pi radians 

% w= 50} frequency samples between 0 to pi radians 
% b= numerator polynomial of H(z) (for FIR: beh) 
% a= denominator polynomial of H(z) (for FIR: a=[1]) 


(H,w) = freqz(b,a, 1000, whole’); 
H = (H(1:1:501))?; w = (w(1:1:501))?; 
mag = abs(H); 
db = 20*1ogi0((nagteps) /max(mag)) ; 
pha = angle(H); 
grd = grpdelay(b,a,w); 


We now provide several examples of FIR filter design using window tech- 
niques and MATLAB routines. 
Design a digital FIR lowpass filter with the following specifications: 
wp =0.2n, Rp = 0.25 dB 
ws, = 0.37, A; = 50 dB 
Choose an appropriate window function from Table 7.1. Determine the impulse 


response and provide a plot of the frequency response of the designed filter. 


Both the Hamming and Blackman windows can provide attenuation of more 
than 50 dB. Let us choose the Hamming window, which provides the smaller 
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transition band and hence has the smaller order. Although we do not use the 
passband ripple value of Rp = 0.25 dB in the design, we will have to check 
the actual ripple from the design and verify that it is indeed within the given 
tolerance. The design steps are given in the following MATLAB script. 


>> wp = 0.2*pi; ws = 0.3*pi; 

>> tr width = ws - wp; 

>> M = ceil(6.6*pi/tr_width) + 1 

M = 67 

>> n-[0:1:M-1]; 

>> wc = (wstwp)/2, % Ideal LPF cutoff frequency 

>> hd = ideal lp(wc,M); 

>> wham = (hamming(M))’; 

>> h = hd .* w ham; 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 

>> delta_w = 2*pi/1000; 

>> Rp = -(min(db(1:1:wp/delta_w+1))); % Actual Passband Ripple 

Rp = 0.0394 

>> As = -round(max(db(ws/delta w*1:1:501))) % Min Stopband attenuation 
As = 52 

% plots 

>> subplot(1,1,1) 

>> subplot (2,2,1); stem(n,hd); title('Ideal Impulse Response’) 

>> axis([0 M-1 -0.1 0.3)); xlabel(’n’); ylabel (’hd(n)’) 

>> subplot (2,2,2); stem(n,w_ham) ;title(’Hamming Window’) 

>> axis([0 M-1 0 1.1]); xlabel(’n’); ylabel('w(n)?) 

»» subplot(2,2,3); stem(n,h);title('Actual Impulse Response’) 

>> axis([0 M-1 -0.1 0.3}]); xlabel(’n’); ylabel (’h(n)’) 

>> subplot (2,2,4); plot (w/pi,db) ;title(’Magnitude Response in dB’) ;grid 
>> axis([0 1 -100 101); xlabel(’frequency in pi units’); ylabel (’Decibels’) 


Note that the filter length is M = 67, the actual stopband attenuation is 52 
dB, and the actual passband ripple is 0.0394 dB. Clearly, the passband ripple is 
satisfied by this design. This practice of verifying the passband ripple is strongly 
recommended. The time- and the frequency-domain plots are shown in Figure 
7.16. a 


EXAMPLE 7.9 For the design specifications given in Example 7.8, choose the Kaiser window 


and design the necessary lowpass filter. 


The design steps are given in the following MATLAB script. 


>> wp = 0.2*pi; ws = 0.3*pi; As = 50; 

>> tr width = ws - Wp; 

>> M = ceil((As-7.95)/(14.36*tr width/(2*pi))*1) + 1 
M = 61 

>> n=[0:1:M-1]; 

>> beta = 0.1102*(As-8.7) 
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Ideal Impulse Response 


Hamming Window 





hd(n) 











h(n) 





FIGURE 7.16 Lowpass filter plots for Example 7.8 


beta = 4.5513 

>> wc = (ws+wp)/2; 

>> hd = ideal lp(wc,M); 

>> w kai = (kaiser(M,beta))’; 

>> h= hd .* v, kai; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> delta_w = 2*pi/1000; 

>> As = -round(max(db(ws/delta w*1:1:501))) % Min Stopband Attenuation 
As = 52 

% Plots 

>> subplot(1,1,1) 

>> subplot(2,2,1); stem(n,hd); title(’Ideal Impulse Response?) 

>> axis([0 M-1 -0.1 0.3]); xlabel(’n’); ylabel(’hd(n)’) 

»» subplot(2,2,2); stem(n,w kai);title('Kaiser Window’) 

>> axis([0 M-1 O 1.1)); xlabel(’n’); ylabel(’?w(n)’) 

>> subplot(2,2,3); stem(n,h);title('Actual Impulse Response’ ) 

>> axis([0 M-1 -0.1 0.3]); xlabel(’n’); ylabel(’h(@)’) 

>> subplot(2,2,4);plot(w/pi,db);title('Magnitude Response in dB’) ;grid 
>> axis([0 1 -100 10]); xlabel( frequency in pi units’); ylabel(’Decibels’) 


Note that the Kaiser window parameters are M = 61 and f = 4.5513 and that 
the actual stopband attenuation is 52 dB. The time- and the frequency-domain 
plots are shown in Figure 7.17. o 
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FIGURE 7.17 Lowpass filter plots for Example 7.9 


O EXAMPLE 7.10 Let us design the following digital bandpass filter. 


lower stopband edge: wi,=0.20, As = 60 dB 
lower passband edge: wip = 0.357, Rp = 1 dB 
upper passband edge: wap = 0.657 Rp = 1 dB 
upper stopband edge: w2s = 0.87 A, = 60 dB 


These quantities are shown in Figure 7.18. 


ae 


ed 





Decibels 
€O----------|à$ 





FIGURE 7.18 Bandpass filter specifications in Example 7.10 
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Solution There are two transition bands, namely, Aw: 2 wip — wis and Au Swe, —Wep- 
These two bandwidths must be the same in the window design; that is, there is 
no independent control over Aw, and Awe. Hence Aw: = Aw; = Aw. For this 
design we can use either the Kaiser window or the Blackman window. Let us 
use the Blackman Window. We will also need the ideal bandpass filter impulse 
response ha (n). Note that this impulse response can be obtained from two ideal 
lowpass magnitude responses, provided they have the same phase response. 
This is shown in Figure 7.19. Therefore the MATLAB routine ideal-lp(wc,M) 
is sufficient to determine the impulse response of an ideal bandpass filter. The 
design steps are given in the following MATLAB script. 

>> wsi = 0.2*pi; wpi = O.35*pi; 
>> wp2 = 0.65*pi; ws2 = 0.8*pi; 
>> As = 60; 
>> tr width = min((wpi-ws1) , (ws2-wp2)); 
>> M = ceil(ii*pi/tr width) + 1 
M = 75 
>> ne[0:1:M-1]; 
>> wci = (wsitwpi)/2; wc2 = (wp2+ws2)/2; 
>> hd = ideal lp(wc2,M) - ideal lp(wci,M); 
>> w bla = (blackman(M))'; 
>> h = hd .* w. bla; 
»» [db,mag,pha,grd,w] * freqz_m(h, [1]); 
>> delta w = 2*pi/1000; 
>> Rp = -min(db(wp1/delta_wt1:1:wp2/delta_w)) % Actua; Passband Ripple 
Rp = 0.0030 
>> As = -round(max(db(ws2/delta w*1:1:501))) % Min Stopband Attenuation 
As = 75 
Plots 
>> subplot (2,2,1); stem(n,hd) ; title('Ideal Impulse Response’) 
>> axis([0 M-1 -0.4 0.5]); xlabel(’n’); ylabel(’hd(n) ’) 
>> subplot (2,2,2); stem(n,w_bla) ;title(’Blackman Window’) 
>> axis([0 M-1 0 1.1]); xlabel(’n’); ylabel(’w(n)’) 
T 
0 2 + 
T 
0 c1 c2 
7 
0 Wey 
FIGURE 7.19 Ideal bandpass filter from two lowpass filters 
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subplot(2,2,3); stem(n,h);title(’Actual Impulse Response’) 
axis([0 M-1 -0.4 0.5]); xlabel(’n’); ylabel(’h(n)’) 
subplot (2,2,4) splot (u/pi,db) ;axis([O 1 -150 10); 
title(’Magnitude Response in dB');grid; 

xlabel('frequency in pi units’); ylabel(’Decibels’) 


Note that the Blackman window length is M = 61 and that the actual stopband 
attenuation is 75 dB. The time- and the frequency-domain plots are shown in 
Figure 7.20. D 


The frequency response of an ideal bandstop filter is given by 


1, 0< |u| < 7/3 
H.(e&*)=4 0, 1/3 Sls 2n/3 
1, 2n/3<|wl| € 7 


Using a Kaiser window, design a bandstop filter of length 45 with stopband 
attenuation of 60 dB. 


Note that in these design specifications, the transition bandwidth is not given. 
It will be determined by the length M = 45 and the parameter f of the Kaiser 


Blackman Window 


Ideal Impulse Response 





0 02 035 065 08 1 
frequency in pi units 





FIGURE 7.20 Bandpass filter plots in Example 7.10 
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window. From the design equations (7.30) we can determine B from A,; that is, 
B = 0.1102 x (A, — 8.7) 


The ideal bandstop impulse response can also be determined from the ideal 
lowpass impulse response using a method similar to Figure 7.19. We can now 
implement the Kaiser window design and check for the minimum stopband 
attenuation. This is shown in the following MATLAB script. 


>> M = 45; As = 60; n=[0:1:M-1]; 

>> beta = 0.1102*(As-8.7) 

beta = 5.6533 

>> w_kai = (kaiser(M,beta))’; 

>> wcl = pi/3; wc2 = 2*pi/3; 

>> hd = ideal lp(wci,M) + ideal lp(pi,M) - ideal lp(wc2,M); 
>> h = hd .* w, kai; 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 

>> subplot (1,1,1); 

>> subplot (2,2,1); stem(n,hd); title(’Ideal Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel('hd(n)") 

>> subplot(2,2,2); stem(n,w kai);title("Kaiser Window’) 

>> axis([-1 M O 1.1]); xlabel(’n’); ylabel(’w(n)’) 

»» subplot(2,2,3); stem(n,h);title(’Actual Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel(’h(n)’) 

»» subplot(2,2,4);plot(w/pi,db); axis([O 1 -80 10D; 

»» title('Magnitude Response in dB');grid; 

>> xlabel(?frequency in pi units’); ylabel(’Decibels’) 


The @ parameter is equal to 5.6533, and from the magnitude plot in Figure 
7.21 we observe that the minimum stopband attenuation is smaller than 60 
dB. Clearly, we have to increase f to increase the attenuation to 60 dB. The 
required value was found to be 6 = 5.9533. 


Magnitude Response in dB 


Decibels 








0 1/3 2/3 1 
frequency in pi units 


FIGURE 7.21 Bandstop filter magnitude response in Example 7.11 for B 
5.6533 
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>> M = 45; As = 60; n*[0:1:M-1]; 

>> beta = 0.1102*(As-8.7)+0.3 

beta = 5.9533 

>> w.kai = (kaiser(M,beta))'; 

>> weil = pi/3; wc2 = 2*pi/3; 

>> hd = ideal lp(wci,M) + ideal lp(pi,M) - ideal lp(wc2,M); 
>> h = hd .* « kai; 

>> [db,mag,pha,grd,w] = freqz_m(h,[1]); 

>> subplot(1,1,1); 

>> subplot(2,2,1); stem(n,hd) ; title(’Ideal Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot(2,2,2); stem(n,w_kai) ;title(’Kaiser Window’) 

>> axis([-1 M O 1.1]); xlabel(’n’); ylabel(’w(n)’) 

>> subplot(2,2,3); stem(n,h);title('Actual Impulse Response’) 
>> axis([-1 M -0.2 0.8]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot(2,2,4);plot(w/pi,db); axis([O 1 -80 10}); 

»» title('Magnitude Response in dB');grid; 

>> xlabel('frequency in pi units’); ylabel(^Decibels') 


The time- and the frequency-domain plots are shown in Figure 7.22, in which 
the designed filter satisfies the necessary requirements. n 





hd(n) 








hin) 


Decibels 


Jul. 


frequency in pi units 
FIGURE 7.22  Bandstop filter plots in Example 7.11: P = 5.9533 
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O EXAMPLE 7112 The frequency response of an ideal digital differentiator is given by 


H (e")- jw, O<wet 
4 —jw, -"T«w«0 


Using a Hamming window of length 21, design a digital FIR differentiator. Plot 


the time- and the frequency-domain responses. 


by 


ha(n) = F [Ha (8) e] = E ji Ha (e^) e" "^d 


o x 

aoe ES = —jaw jwn Ae : -jaw jun 

=z | jw)e e aes x fiwe ed 
Za 0 


The ideal impulse response of a digital differentiator with linear phase is given 


The above impulse response can be implemented in MATLAB along with the 
Hamming window to design the required differentiator. Note that if M is an 
even number, then a = (M — 1) /2 is not an integer and ha (n) will be zero 
for all n. Hence M must be an odd number, and this will be a Type-3 linear- 
phase FIR filter. However, the filter will not be a full-band differentiator since 


H, (x) = 0 for Type-3 filters. 


>> M = 21; alpha = (M-1)/2; 

>> n = 0:M-1; 

>> hd = (cos(pi*(n-alpha)))./(n-alpha); hd(alphati)=0; 

>> wham = (bamming(M))’; 

>> h= hd .* w ham; 

>> [Hr,w,P,L] = Hr Type3(b); 

% plots 

»» subplot(1,1,1); 

»» subplot(2,2,1); stem(n,hd); title('Ideal Impulse Response?) 
>> axis([-1 M -1.2 1.2]); xlabel(’n’); ylabel(’hd(n)’) 

>> subplot (2,2,2); stem(n,w_ham) ;title(’Hamming Window’) 

>> axis({-i M 0 1.2)); xlabel(’n’); ylabel(’w(n)’) 

>> subplot (2,2,3); stem(n,h);title(’Actual Impulse Response’) 
>> axis([-1 M -1.2 1.2]); xlabel(’n’); ylabel(’h(n)’) 

>> subplot (2,2,4) ;plot(w/pi,Hr/pi); title(’ Amplitude Response’); grid; 


O EXAMPLE 7.13 


Solution 
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n frequency in pi units 
FIGURE 7.23 FIR differentiator design in Example 7.12 


Design a length-25 digital Hilbert transformer using a Hanning window. 


The ideal frequency response of a linear-phase Hilbert transformer is given by 


; jei, 0«w«m 
Ha (d) 2 4 ous (7.32) 
Tje7?", -m «w«0 
After inverse transformation the ideal impulse response is given by 
2 sin? n (n — 
2 sin^ 1 (n o2 nia 
ha(n)= 4 T n—a 
0, n-a 


which can be easily implemented in MATLAB. Note that since M = 25, the 
designed filter is of Type-3. 


>> M = 25; alpha = (M-1)/2; 

>> n = 0:M-1; 

>> hd = (2/pi)*((sin((pi/2)*(n-alpha)).^2)./(n-alpha)); hd(alphati)=0; 
>> whan = (hanning(M))’; 


>> 


xlabel('frequency in pi units’); ylabel('slope in pi units’); axis([O 1 0 1); 


The plots are shown in Figure 7.23. ü 
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>> h = hd .* w han; 

>> (Hr,w,P,L] = Hr_Type3(h); 
% plots 

>> subplot(1,1,1); 
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FIGURE 7.24 FIR Hilbert transformer design in Example 7.13 


>> subplot (2,2,1); stem(n,hd); title('Ideal Impulse Response!) 

>> axis({-1 M -1.2 1.2); xlabel(’n’); ylabelChd(n)?) 

>> subplot(2,2,2); stem(n,w_han) ;title(’Hanning Window’) 

>> axis([-1 M O 1.2]); xlabel(’n’); ylabel(?w(n)’) 

>> subplot (2,2,3); stem(n,h);title('Actual Impulse Response?) 

>> axis([-1 M -1.2 1.2); xlabel(’n’); ylabel(’h(n)’) 

>> ww’; Hr = Hr’; 

>> w = [-fliplr(w), w(2:501)]; Hr = (-fliplr(Hr), Hr(2:501)]; 

>> subplot(2,2,4) ;plot (w/pi,Hr) ; title(’ Amplitude Response’) ; grid; 

>> xlabel(’frequency in pi units’); ylabel(’Hr’); axis([-1 1 -1.1 1.1D; 


The plots are shown in Figure 7.24. Observe that the amplitude response is 
plotted over -r € w € m. u 


FREQUENCY SAMPLING DESIGN TECHNIQUES 
ee 


In this design approach we use the fact that the system function H (z) 
can be obtained from the samples H (k) of the frequency response H (e). 
Furthermore, this design technique fits nicely with the frequency sampling 
structure that we discussed in Chapter 6. Let h(n) be the impulse response 
of an M-point FIR filter, H(k) be its M-point DFT, and H (z) be its 


nr 
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system function. Then from (6.12) we have 


M-1 M-1 
a 1-zM H(k 
k=0 


n=0 





and 


1 — eM X3 H(k) 


M 1- eg jw gidnk/M 
k=0 


H (ð) = (7.34) 


with 
> H (0) k=0 
d 2rk/M | _ , 
H (k) H (2 ) aver k=1,...,.M-1 
For a linear-phase FIR filter we have 
h(n) = +h(M —1-— n), n=0,1,...,.M-1 


where the positive sign is for the Type-1 and Type-2 linear-phase filters, 
while the negative sign is for the Type-3 and Type-4 linear-phase filters. 
Then H (k) is given by 


H(k) =H; C) eic) (1.35) 
where 
H (5) - P oi iaa (7.36) 
"AM H, (255-8), EsisgoM-4 
and 


Cer): etel 


BOY rote aeger 
(7.37) 
" 
DEDE) e 
LH (k) = - (2) (F) een. , (Lype-3 & 4) 
ee [2| nsn (7.38) 
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Hale!) 






Finally, we have 
h(n) = IDFT [H(k)] (7.39) 


Note that several textbooks (e.g., [19, 20, 16]) provide explicit formu- 
las to compute h(n), given H(k). We will use MATLAB’s ifft routine to 
compute h(n) from (7.39). 


Basic Idea Given the ideal lowpass filter Hale”), choose the filter 
length M and then sample Ha(e?”) at M equispaced frequencies between 
0 and 2r. The actual response H (e/") is the interpolation of the samples 
H(k) given by (7.34). This is shown in Figure 7.25. The impulse response 
is given by (7.39). Similar steps apply to other frequency-selective filters. 
Furthermore, this idea can also be extended for approximating arbitrary 
frequency-domain specifications. 
From Figure 7.25 we observe the following: 


1. The approximation error—that is, the difference between the ideal 
and the actual response—is zero at the sampled frequencies. 

2. The approximation error at all other frequencies depends on the 
shape of the ideal response; that is, the sharper the ideal response, the 
larger the approximation error. 

3. The error is larger near the band edges and smaller within the 
band. 


There are two design approaches. In the first approach we use the 
basic idea literally and provide no constraints on the approximation error; 
that is, we accept whatever error we get from the design. This approach is 
called a naive design method. In the second approach we try to minimize 
error in the stopband by varying values of the transition band samples. 
It results in a much better design called an optimum design method. 






Frequency Samples and 
Approximated Response 


Ideal Response and 
Frequency Samples 


k, 0 k, 
345678917 ” 0123475678 9107 ” 


FIGURE 7.25 Pictorial description of frequency sampling technique 
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NAIVE DESIGN In this method we set H(k) = Ha(e/?7*/M),  k — 0,..., M — 1 and use 
METHOD (7.35) through (7.39) to obtain the impulse response h(n). 


o 


EXAMPLE 7.14 Consider the lowpass filter specifications from Example 7.8. 


wp =0.27, R,-0.25 dB 
ws =0.37, A, = 50 dB 


Design an FIR filter using the frequency sampling approach. 


Solution Let us choose M = 20 so that we have a frequency sample at wp, that is, at 
k=2: 
Qn 
= 0.27 = — 
Wp = 0.27 20? 


and the next sample at ws, that is, at k = 3: 
2r 
29? 

Thus we have 3 samples in the passband [0 < w X wp] and 7 samples in the 
stopband [w, < w < 7]. From (7.36) we have 


Ws = 0.37 = 


H, (k) = [1,1,1,0,...,0,1,]] 
ee 


15 zeros 


Since M = 20, a = 2971 = 9.5 and since this is a Type-2 linear-phase filter, 
from (7.37) we have 


22 
—9.5——k = —0. <k< 
LH(k) = 20 0.95tk, OSkK<9 


40.95 (20 — k), 10 € k € 19 


Now from (7.35) we assemble H (k) and from (7.39) determine the impulse 
response h (n). The MATLAB script follows: 


M = 20; alpha = (M-1)/2; 1 = 0:M-1; wl = (2*pi/M)*1; 
Hrs = [1,1,1,zeros(1,15),1,1]; “Ideal Amp Res sampled 
Hdr = [1,1,0,0]; wdl = [0,0.25,0.25,1]; %Ideal Amp Res for plotting 
ki = O:floor((M-1)/2); k2 = floor((M-1)/2)*1:M-1; 

angH = [-alpha*(2*pi)/M*ki, alpha*(2*pi)/M*(M-k2)]; 

H = Hrs.*exp(j*angH) ; 

h = real(ifft(H,M)); 

{db,mag,pha,grd,w] = freqz_m(h,1); 

(Hr, ww,a,L] = Hr_Type2(h); 

subplot (1,1,1) 

subplot (2,2,1) ;plot(w1(1:11)/pi,Hrs(1:11),’o’ ,wdl, Hdr); 
axis([0,1,-0.1,1.1)); title(’Frequency Samples: M=20’) 
xlabel(’frequency in pi units’); ylabel(’Hr(k)’) 
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>> subplot (2,2,2); stem(1,h); axis((-1,M,-0.1,0.3]) 

>> title(’ Impulse Response’); xlabel(’n’); ylabelCh(2)?); 

>> subplot (2,2,3); plot (ww/pi,Hr,wi(1:11)/pi,Hre(1:11),’07); 

>> axis([0,1,-0.2,1.2]); title(’ Amplitude Response’) 

>> xlabel(’ frequency in pi units’); ylabel (’Hxr(w)’) 

>> subplot (2,2,4) splot (w/pi,db) ; axis([0,1,-60,10]); grid 

>> title('Magnitude Response’); xlabel(’ frequency in pi units’); ylabel(’Decibels’) ; 


The time- and the frequency-domain plots are shown in Figure 7.26. Observe 
that the minimum stopband attenuation is about 16 dB, which is clearly unac- 
ceptable. If we increase M, then there will be samples in the transition band, 
for which we do not precisely know the frequency response. Therefore the naive 


design method is seldom used in practice. D 
OPTIMUM To obtain more attenuation, we will have to increase M and make the 
DESIGN transition band samples free samples—that is, we yary their values to 
METHOD obtain the largest attenuation for the given M and the transition width. 


This problem is known as an optimization problem, and it is solved using 
linear programming techniques. We demonstrate the effect of transition 
band sample variation on the design using the following example. 





Frequency Samples: M=20 Impulse Response 
0.2 
= = 
= = 0.1 
0 
-0.1 
0 0.20.3 1 0 5 10 15 20 
frequency in pi units n 


Amplitude Response 


——— 














0 0203 1 20. 
frequency in pi units frequency in pi units 


FIGURE 7.26 Naive frequency sampling design method 
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D EXAMPLE T5 Using the optimum design method, design a better lowpass filter of Example 
7.14. 


Solution Let us choose M = 40 so that we have one sample in the transition band 


0.20 < w < 0.37. Since wi £ 27/40, the transition band samples are at k=5 
and at k = 40 ~ 5 = 35. Let us denote the value of these samples by Ti, 
0 < T, < 1; then the sampled amplitude response is 


H, (k) = (1,1,1,1,1,71,0,...,0,71,1,1,1, 0) 
—— 


29 zeros 


Since a = Ed — 19.5, the samples of the phase response are 


-19.527& = —0.9757k, O<k<S19 
LH (k) = 40 


--0.9757 (40 — k), 20 < k < 39 


Now we can vary T, to get the best minimum stopband attenuation. This will 
result in the widening of the transition width. We first see what happens when 
Ti — 0.5. 


4 Ti = 0.5 

>> M = 40; alpha = (M-1)/2; 

>> Hrs = [ones (1,5) ,0.5,zeros (1,29) ,0.5,ones(1,4)); 
>> ki = O:floor((M-1)/2); k2 = floor((M-1)/2)*1:M-1; 
>> angH = [-alpha*(2*pi)/M*k1, alphas (2*pi) /M*(M-k2)]; 
>> H = Hrs.*exp(j*angH) ; 

>> h = real(ifft(H,M)); 


From the plots of this design in Figure 7.27 we observe that the minimum 
stopband attenuation is now 30 dB, which is better than the naive design at- 
tenuation but is still not at the acceptable level of 50 dB. The best value for T; 
Was obtained by varying it manually (although more efficient linear program- 
ming techniques are available, these were not used in this case), and the near 
optimum solution was found at T, = 0.39. 


% Ti = 0.39 

>> M = 40; alpha = (M-1)/2; 

>> Hrs = [ones(1,5),0.39,zeros(1,29) ,0.39,0nes(1,4)]; 
>> ki = 0:floor((M-1)/2); k2 = floor((M-1)/2)*1:M-1; 
>> angH = [-alpha*(2*pi)/M+k1, alpha*(2*pi) /M*(M-k2)] ; 
>> H = Hrs. *exp(j*angH) ; 

>> h = real(ifft(H,M)); 


From the plots in Figure 7.28 we observe that the optimum stopband attenu- 
ation is 43 dB. It is obvious that to further increase the attenuation, we will 
have to vary more than one sample in the transition band. o 
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Frequency Samples: M=40,T1=0.5 Impulse Response 
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frequency in pi units 
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FIGURE 7.27 Optimum frequency design method: Ty = 0.5 


Frequency Samples: M-40,T1-0.39 Impulse Response 
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h(n) 
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FIGURE 7.28 Optimum frequency design method: Ty = 0.39 
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D EXAMPLE 7.16 


Solution 


C] EXAMPLE 7.17 


Clearly, this method is superior in that by varying one sample we 
can get a much better design. In practice the transition bandwidth is 
generally small, containing either one or two samples. Hence we need to 
optimize at most two samples to obtain the largest minimum stopband 
attenuation. This is also equivalent to minimizing the maximum side lobe 
magnitudes in the absolute sense. Hence this optimization problem is also 
called à minimaz problem. This problem is solved by Rabiner et al. [20], 
and the solution is available in the form of tables of transition values. 
A selected number of tables are also available in [19, Appendix BJ. This 
problem can also be solved in MATLAB, but it would require the use of 
the Optimization toolbox. We will consider a more general version of this 
problem in the next section. We now illustrate the use of these tables in 
the following examples. 


Let us revisit our lowpass filter design in Example 7.14. We will solve it using two 
samples in the transition band so that we can get a better stopband attenuation. 


Let us choose M — 60 so that there are two samples in the transition band. Let 
the values of these transition band samples be T, and Tz. Then H, (w) is given 
by 


H (w) = 1,...,1,71,72,0,...,0, 72, T1, 1, ...,1] 
7 ones 43 zeros 6 ones 


From tables in [19, Appendix B] Ti = 0.5925 and Tz = 0.1099. Using these 
values, we use MATLAB to compute h(n). 


M = 60; alpha = (M-1)/2; 1 = 0:M-1; wl = (2*pi/M)*1; 

Hrs = [ones (1,7) ,0.5925,0. 1099, zeros (1,43) ,0.1099,0.5925,ones(1,6)1; 
Hdr = [1,1,0,0]; wdl = [0,0.2,0.3,1]; 

ki = 0:floor((M-1)/2); k2 = floor ((M-1)/2)+1:M-1; 

angH = [-alpha*(2*pi)/M*kl, alpha» (2*pi) /M*(M-k2)] ; 

H = Hrs.*exp(j*angH) ; 

h = real(ifft(H,M)); 

[db,mag,pha,grd,w] = freqz_m(h,1); 

(Hr, ww,a,L] = Hr Type2(h); 


The time- and the frequency-domain plots are shown in Figure 7.29. The min- 
imum stopband attenuation is now at 63 dB, which is acceptable. n 


Design the bandpass filter of Example 7.10 using the frequency sampling tech- 
nique. The design specifications are these: 

lower stopband edge: wi. = 0.2m, As = 60 dB 

lower passband edge: wip = 0.357, Rp=1 dB 

upper passband edge: wap = 0.657 Rp = 1dB 

upper stopband edge: was = 0.87 A, = 60 dB 
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Lowpass: M=60,T1=0.59, T2=0.109 Impulse Response 





h(n) 








0 020.3 1 
frequency in pi units 
Amplitude Response 
0 
2 
0 0.20.3 1 0 0.203 1 
frequency in pi units frequency in pi units 


FIGURE 7.29 Lowpass filter design plots in Example 7.16 


Solution Let us choose M = 40 so that we have two samples in the transition band. 
Let the frequency samples in the lower transition band be T, and 75. Then the 
samples of the amplitude response are 


H, (w) = 0,1,0, 7, Tos 1,- -s L, Tas 73,0,...,0, T, Tasli.. -3 1, 5,3, 0,...,0] 


5 7 9 7 4 


The optimum values of T, and Tz for M = 40 and seven samples in the passband 
[19, Appendix B] are 


T, = 0.109021, T» = 0.59417456 


The MATLAB script is 


>> M = 40; alpha = (M-1)/2; 1 = 0:M-1; wl = (2*pi/M)*1; 

>> Ti = 0.109021; T2 = 0.59417456;  — 

>> Hrs = ([zeros(1,5),T1,T2,ones(1,7) , T2, T1 zeros (1,9) ,T1, 12, ones(1,7) ,T2, T1 ,zeros (1,4)] ; 
>> Hdr = (0,0,1,1,0,0]; wdl = (0,0.2,0.35,0.65,0.8,1]; 

>> ki = O:floor((M-1)/2); k2 = floor((M-1)/2)*1:M-1; 

>> angH = (-alpha*(2*pi)/M+k1, alpha*(2*pi)/M*(M-k2)]; 

>> H = Hrs. *exp(j*angH) ; 


aS 
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>> h = real(ifft(H,M)); 
>> [db,mag,pha,grd,w] = freqz_m(h,1); 
>> [Hr,ww,a,L] = Hr_Type2(h) ; 


The plots in Figure 7.30 show an acceptable bandpass filter design. n 


O EXAMPLE 7.18 Design the following highpass filter: 
Stopband edge: w,=0.6r As, = 50 dB 
Passband edge: wp=0.8r Rp = 1 dB 


Solution Recall that for a highpass filter M must be odd (or Type-1 filter). Hence we 
will choose M — 33 to get two samples in the transition band. With this choice 
of M it is not possible to have frequency samples at ws and wp. The samples of 
the amplitude response are 

H, (k) = [0,...,0, Ti, 15, 3, ...,1, 72, 3, 0... .,0 
(k) 1, T2 2,71 J 
1 8 10 
while the phase response samples are 
33— 12m 32 


~ kh = -5 < 
5 33° 337^ O<k< 16 


LH(B)=4 a 
+557 (33 — k), 17 <k <32 


Bandpass: M=40,T1=0.5941, T2=0.109 


h(n) 









0 0.2 0.35 0.65 08 1 
frequency in pi units 


P 


0 02035 065 08 1 0 02 035 0.65 0.8 1 
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FIGURE 7.30 Bandpass filter design plots in Example 7.17 
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C] EXAMPLE 7.19 


The optimum values of transition samples are Tj = 0.1095 and Tz = 0.598. 
Using these values, the MATLAB design is 


>> M = 33; alpha = (M-1)/2; 1 = 0:M-1; wl = (2*pi/M)*1; 
>> Ti = 0.1095; T2 = 0.598; 

>> Hrs = [zeros (1,11), T1, T2, ones (1,8) , T2, T1 , zeros (1,10)] ; 
>> Hdr = [0,0,1,1]; wdl = [0,0.6,0.8,11; 

>> ki = 0:floor((M-1)/2); k2 = floor ((M-1)/2)+1:M-1; 

>> angH = [-alpha*(2*pi)/M*k1, alpha*(2*pi)/M*(M-k2)]; 
>> H = Hrs.*exp(j*angB); 

>> h = real(ifft(H,M)); 

>> [db,mag,pha,grd,w] = freqz_m(h,1); 

>> [Hr,ww,a,L] = Hr Typei(h); 


The time- and the frequency-domain plots of the design are shown in Figure 
7.31. B 


Design a 33-point digital differentiator based on the ideal differentiator of (7.31) 
given in Example 7.12. 


Highpass: M=33,T1=0.1095,T2=0.598 
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FIGURE 7.31  Highpass filter design plots in Example 7.18 
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Solution From (7.31) the samples of the (imaginary-valued) amplitude response are given 
by 
eek k- 0... | 7] 
: M 2 
JH: (k) = 2n M-1 
-j25(M-k), k= |---| +1,...,M-1 








-M1r Mis, k=0,...,|"=*| 
£H()-3 yyy M-1 

eI *n(M—R), =|*] +3 M-1 
Therefore 


H(k)-jH.(k)?^"9, o«k«M-1 and  h(n)-IDFT[H (E) 
>> M = 33; alpha = (M-1)/2; Dw = 2*pi/M; 

>> 1 = 0:M-1; wl = Dv*1; 

>> ki = O:floor((M-1)/2); k2 = floor((M-1)/2)+1:M-1; 

>> Hrs = [jeDw*ki,-j*Dw* (M-k2)1; 

>> angH = [-alpha*Dw*ki, alpha*Dw*(M-k2)]; 

>> H = Hrs.*exp(j*angH); 

>> h = real(ifft(H,M)); 

>> [Hr,ww,a,P]=Hr Type3(h) ; 


The time- and the frequency-domain plots are shown in Figure 7.32. We observe 
that the differentiator is not a full-band differentiator. D 


O EXAMPLET.20 Design a 51-point digital Hilbert transformer based on the ideal Hilbert trans- 
former of (7.32). 


Solution From (7.32) the samples of the (imaginary-valued) amplitude response are given 
by 
M-1 
73; k= , D || 
jH.(k)-2 40, k=0 


+j, k= [>] them 


Since this is a Type-3 linear-phase filter, the amplitude response will be zero 
at w = «v. Hence to reduce the ripples, we should choose the two samples (in 
transition bands) near w = 7 optimally between 0 and j. Using our previous 
experience, we could select this value as 0.395. The samples of the phase response 
are selected similar to those in Example 7.19. 
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Differentiator, frequency sampling design : M = 33 
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FIGURE 7.32 Differentiator design plots in Example 7.19 


>> M = 51; alpha = (M-1)/2; Dw = 2*pi/M; 

>> 1 0:M-1; wl = Dw*1; 

>> ki = O:floor((M-1)/2); k2 = floor((M-1)/2)*1:M-1; 

>> Hrs = (0, - j*ones (1, (M-3)/2),-0.39j,0.39j, j*ones (1, (M-3)/21; 
>> angH = [-alpha*Dw*ki, alpha*Dwu* (M-k2)] ; 

>> H = Hrs.*exp(j*angH); 

>> h = real(ifft(H,M); 

>> [Hr,ww,a,P]=Hr_Type3(h); 


The plots in Figure 7.33 show the effect of the transition band samples. ü 


The type of frequency sampling filter that we considered is called a 
Type-A filter, in which-the sampled frequencies are 


22 
= <k< = 
Wk u^ O0<k<M-1 
There is a second set of uniformly spaced samples given by 
_ on (k + 3) 
= M ^ 


Wk 0<k<M-1 


This is called a Type-B filter, for which a frequency sampling structure is 
also available. The expressions for the magnitude response H (e?) and the 


M he eS ee ee 
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Hilbert Transformer, frequency sampling design : M = 51 
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FIGURE 7.33 Digital Hilbert transformer design plots in Example 7.20 


impulse response h(n) are somewhat more complicated and are available 
in [19]. Their design can also be done in MATLAB using the approach 
discussed in this section. 


OPTIMAL EQUIRIPPLE DESIGN TECHNIQUE 
L—— — ——————23——— 


The last two techniques—namely, the window design and the frequency 
sampling design—were easy to understand and implement. However, they 
have some disadvantages. First, we cannot specify the band frequencies 
wy and ws precisely in the design; that is, we have to accept whatever 
values we obtain after the design. Second, we cannot specify both 6, and 
65 ripple factors simultaneously. Either we have 6, = 52 in the window 
design method, or we can optimize only 62 in the frequency sampling 
method. Finally, the approximation error—that is, the difference between 
the ideal response and the actual response—is not uniformly distributed 
over the band intervals. It is higher near the band edges and smaller in 
the regions away from band edges. By distributing the error uniformly, 
we can obtain a lower-order filter satisfying the same specifications. For- 
tunately, a technique exists that can eliminate the above three problems. 
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This technique is somewhat difficult to understand and requires a com- 
puter for its implementation. 

For linear-phase FIR filters it is possible to derive a set of conditions 
for which it can be proved that the design solution is optimal in the sense 
of minimizing the mazimum approximation error (sometimes called the 
minimaz or the Chebyshev error). Filters that have this property are called 
equiripple filters because the approximation error is uniformly distributed 
in both the passband and the stopband. This results in lower-order filters. 

In the following we first formulate a minimax optimal FIR design 
problem and discuss the total number of maxima and minima (collec- 
tively called extrema) that one can obtain in the amplitude response of 
a linear-phase FIR filter. Using this, we then discuss a general equiripple 
FIR filter design algorithm, which uses polynomial interpolation for its 
solution. This algorithm is known as the Parks-McClellan algorithm, and 
it incorporates the Remez exchange routine for polynomial solution. This 
algorithm is available as a subroutine on many computing platforms. In 
this section we will use MATLAB to design equiripple FIR filters. 


Earlier in this chapter we showed that the frequency response of the four 
cases of linear-phase FIR filters can be written in the form 


H(t) = Pei THH, (w) 


where the values for f and the expressions for H,(w) are given in Table 
7.2. 


TABLE 7.2 Amplitude response and B-values for linear-phase FIR filters 
a e—a 


Linear-phase FIR Filter Type B H, (e) 
(M-1)/2 
Type-1: M odd, symmetric h(n) 0 35 a(n)cosun 
0 
M/2 
Type-2: M even, symmetric h(n) 0 32 b(n) cos [w(n — 1/2)] 
1 

T (M-1)/2 

Type-3: M odd, antisymmetric h(n) 3 35 e(n)sinwn 


1 


M/2 
Y. d(n) sin [w(n — 1/2)] 
1 


MEE SE 


Type-4: M even, antisymmetric h(n) 


t2] 3 


TABLE 7.3 Q(w), L, and P(w) for linear-phose FIR filters 





LP FIR Filter Type Qi) L P(w) 
kx niu do La S AEE 
= L 
Type-1 1 ; M- 1 3 a(n) coswn 
0 
| w M L. 
Type-2 / COS = = -i P b(n) cosun 
P 2 2 o 
: M-3 L 
Type-3 sinw = ¥en) coswn 
0 
w M Ls 
Type-4 sin 3 uo 1 35 d(n) coswn 
r] 





Using simple trigonometric identities, each expression for H, (w) above 
can be written as a product of a fixed function of w (call this Q(w)) and a 
function that is a sum of cosines (call this P(w)). For details see [19] and 
Problems 7.1-7.4. Thus 


H, (w) = Q(w)P(w) (7.40) 
where P(w) is of the form 


L 
P(w) = X a(n) cosun (7.41) 


n=0 


and Q(w), L, P(w) for the four cases are given in Table 7.3. 

The purpose of this analysis is to have a common form for H,(w) 
across all four cases. It makes the problem formulation much easier. To 
formulate our problem as a Chebyshev approximation problem, we have 
to define the desired amplitude response Ha, (w) and a weighting function 
W(w), both defined over passbands and stopbands. The weighting func- 
tion is necessary so that we can have an independent control over 61 and 
62. The weighted error is defined as 


E(w) $ Ww) [Ha (w) - H(w), w ESS wU wan] (7.42) 


These concepts are made clear in the following set of figures. It shows a 
typical equiripple filter response along with its ideal response. 


nn 
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Amplitude Response of an Equiripple Filter 
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The error [Har (w) — Hr (w)] response is shown below. 











Now if we choose 


ba in the passband 
W (w) = ¢ ô (7.43) 
1, in the stopband 


e a a a a Sata 
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TN. 
Then the weighted error E(w) response is 


"S 


Weighted Error Function 











a RR 
0 0.3 0.5 1 
frequency in pi units 





Thus the maximum error in both the passband and stopband is 62. There- 
fore, if we succeed in minimizing the maximum weighted error to 69, we 
automatically also satisfy the specification in the passband to ó;. Substi- 
tuting H,(w) from (7.40) into (7.42), we obtain 


E (w) = W (w) [Har (w) — Q (w) P ()] 


=wong [9 





-Pw)], wes 


If we define 


Ww) SW w)Qw) and f.) $ O 


then we obtain 
E(w) = Ww) [Roc (o) z P(»)], wes (7.44) 


Thus we have a common form of E(w) for all four cases. 


Problem Statement The Chebyshev approximation problem can now 
be defined as: 


Determine the set of coefficients a(n) or b(n) or &(n) or d(n) [or equiva- 
lently a(n) or b(n) or e(n) or d(n)] to minimize the maximum absolute a 
value of E (w) over the passband and stopband, i.e., 


min. E |E | (7.45) 


coeff. | we 


8 en es E 8S eee 
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CONSTRAINT 
ON THE 
NUMBER OF 
EXTREMA 


Oo 


EXAMPLE 7.21 


Now we have succeeded in specifying the exact wp, Ws, 61, and 65. In 
addition the error can now be distributed uniformly in both the passband 
and stopband. 


Before we give the solution to the above problem, we will first discuss 
the issue: how many local maxima and minima exist in the error function 
E(w) for a given M-point filter? This information is used by the Parks- 
McClellan algorithm to obtain the polynomial interpolation. The answer 
is in the expression P(w). From (7.41) P (w) is a trigonometric function 
in w. Using trigonometric identities of the form 


cos (2w) = 2cos? (w) — 1 


cos (3w) = 4cos? (w) — 3cos (w) 


P (w) can be converted to a trigonometric polynomial in cos (w), which 
we can write (7.41) as 


L 
P(w)= x B(n) cos" w (7.46) 


n-Ü 


Let h(n) = 35[5,2,3,4, 3,2, 1]. Then M = 7 and h(n) is symmetric, which 
means that we have a Type-1 linear-phase filter. Hence L = (M — 1)/2 = 3. 
Now from (7.7) 


a(n) =a(n) -2h(8—n) 1<n<2 and — a(0) = a(0) = A(3) 
or a(n) = $[4,6, 4, 2]. Hence 
3 
P (w) = $ a(n) coswn = jg (4+ 6 cosw + 4 cos 2w + 2cos 3w) 
o 
= {4+ 6cosw + 4(2co8? w — 1) + 2(4cos? w — 3cosw)} 


3 
=0+0+ È cos u + S cos*u = V pln) cos" w 
n 


8 8 
or (n) = [n.o, 15' zl 
From (7.46) we note that P(w) is an Lth-order polynomial in cos(w). Since 
cos(w) is a monotone function in the open interval 0 < w < 7, then it follows 
that the Lth-order polynomial P(w) in cos(w) should behave like an ordinary 
Lth-order polynomial P(x) in z. Therefore P(w) has at most (i.e., no more 


EMEN IM LLL Lr LE Le Ear 
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O EXAMPLE 7.22 


Solution 


THEOREM 1 


has only one minimum at w = 7/2. However, it has three extrema in the closed 
interval 0 < w < 7 (i.e., à maximum at w = 0, a minimum at w = 1/2, and 
a maximum atw = 7). Now if we include the end points w = 0 and w = 7, 
then P (w) has at most (L + 1) local extrema in the closed interval 0 < w < 7. 
Finally, we would like the filter specifications to be met exactly at band edges 
wp and ws. Then the specifications can be met at no more than (L + 3) extremal 
frequencies in the 0 < w < 7 interval. 


Conclusion The error furiction E(w) has at most (Z + 3) extrema in S. 


Let us plot the amplitude response of the filter given in Example 7.21 and count 
the total number of extrema in the corresponding error function. 


The impulse response is 
h(n) = 51L23,4,3,21, M=7 oœ L=3 
and a(n) = 34[4,6,4, 2] and (n) = [0,0, $, &] from Example 7.21. Hence 
_ 8 2 8 os 
P(w) = i; 95 w+ ggs” 


which is shown in Figure 7.34. Clearly, P (w) has (L — 1) = 2 extrema in the 
open interval 0 < w < x. Also shown in Figure 7.34 is the error function, which 
has (L + 3) = 6 extrema. o 


Let us now turn our attention to the problem statement and equa- 
tion (7.45). It is a well-known problem in approximation theory, and the 
solution is given by the following important theorem. 


Alternation Theorem 

Let S be any closed subset of the closed interval [0, n]. In order that 
P(w) be the unique minimaz approzimation to Har (w) on S, it is necessary 
and sufficient that the error function E(w) exhibit at least (L 4-2) "alter- 
nations" or extremal frequencies in S; that is, there must exist (L2) 
frequencies w; in S such that 


E (wi) = —E (wi-1) = + max |E (w)| (7.47) 
2 45, V wo < Wy L CW ES 


Combining this theorem with our earlier conclusion, we infer that 
the optimal equiripple filter has either (L + 2) or (L + 3) alternations 


Nr 
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FIGURE 7.34 Amplitude response and the error function in Example 7.22 


in its error function over S. Most of the equiripple filters have (L + 2) 
alternations. However, for some combinations of wp and ws, we can get 
filters with (L+3) alternations. These filters have one extra ripple in their 
response and hence are called Extra-ripple filters. 


The alternation theorem ensures that the solution to our minimax ap- 
proximation problem exists and is unique, but it does not tell us how 
to obtain this solution. We know neither the order M (or equivalently, 
L), nor the extremal frequencies w;, nor the parameters {a(n)}, nor the 
maximum error 6. Parks and McClellan [17] provided an iterative solution 
using the Remez exchange algorithm. It assumes that the filter length M 
(or L) and the ratio 2/6; are known. If we choose the weighting function 
as in (7.43), and if we choose the order M correctly, then 6 = 62 when 
the solution is obtained. Clearly, 6 and M are related; the larger the M 
the smaller the 6. In the filter specifications 6,, 62, wp, and ws are piven. 
Therefore M has to be assumed. Fortunately, a simple formula, due to 
Kaiser, exists for approximating M. It is given by 


^4  —20 logig Vb182 — 13 EX 
Mf PM VII , _ Ws Up 


NEN ———— aM 
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MATLAB 
IMPLEMEN- 
TATION 


The Parks-McClellan algorithm begins by guessing (L + 2) extremal fre- 
quencies {w;} and estimating the maximum error 6 at these frequencies. 
It then fits an Lth-order polynomial (7.46) through points given in (7.47). 
Local maximum errors are determined over 8 finer grid, and the extremal 
frequencies {w;} are adjusted at these new extremal values. A new Lth- 
order polynomial is fit through these new frequencies, and the procedure 
is repeated. This iteration continues until the optimum set {w;} and the 
global maximum error 6 are found. The iterative procedure is guaranteed 
to converge, yielding the polynomial P(w). From (7.46) coefficients B(n) 
are determined. Finally, the coefficients a(n) as well as the impulse re- 
sponse-h(n) are computed. This algorithm is available in MATLAB as the 
remez function, which is described below. 

Since we approximated M, the maximum error 6 may not be equal to 
69. If this is the case, then we have to increase M (if 5 > 62) or decrease 
M (if 6 < 65) and use the remez algorithm again to determine a new 
6. We repeat this procedure until 6 € 65. The optimal equiripple FIR 
filter, which satisfies all the three requirements discussed earlier is now 
determined. 


The Parks-McClellan algorithm is available in MATLAB as a function 
called remez, the most general syntax of which is 


[h] = remez(N,f,m,weights,ftype) 


There are several versions of this syntax: 


e [h] = remez(N,f,m) designs an Nth-order (note that the length 
of the filter is M = N +1) FIR -digital filter whose frequency response 
is specified by the arrays f and m. The filter coefficients (or the impulse 
response) are returned in array h of length M. The array f contains band- 
edge frequencies in units of 7, that is, 0.0 < f < 1.0. These frequencies 
must be in increasing order, starting with 0.0 and ending with 1.0. The 
array m contains the desired magnitude response at frequencies specified 
in f. The lengths of f and m arrays must be same and must be an even 
number. The weighting function used in each band is equal to unity, which 
means that the tolerances (6;'s) in every band are the same. 

e [h] = remez(N,f ,m,weights) is similar to the above case except 
that the array weights specifies the weighting function in each band. 

e [h] = remez(N,f,m, ftype) is similar to the first case except when 
ftype is the string ‘diff erentiator’ or ‘hilbert’, it designs digital dif- 


1It should be noted that the remez function underwent a small change from the old 
Student Edition to the new Student Edition of MATLAB (or from the Signal Processing 
Toolbox version 2.0b to version 3.0). The description given here applies to the new 
version. 
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EXAMPLE 7.23 


ferentiators or digital Hilbert transformers, respectively. For the digital 
Hilbert transformer the lowest frequency in the f array should not be 
0, and the highest frequency should not be 1. For the digital differentia- 
tor, the m vector does not specify the desired slope in each band but the 
desired magnitude. 

e [h] = remez(N,f,m,weights,ftype) is similar to the above case 
except that the array weights specifies the weighting function in each 
band. 


As explained during the description of the Parks-McClellan algorithm, 
we have to first guess the order of the filter using (7.48) to use the routine 
remez. After we obtain the filter coefficients in array h, we have to check 
the minimum stopband attenuation and compare it with the given A, 
and then increase (or decrease) the filter order. We have to repeat this 
procedure until we obtain the desired A,. We illustrate this procedure in 
the following several MATLAB examples. 


Let us design the lowpass filter described in Example 7.8 using the Parks- 
McClellan algorithm. The design parameters are 


wp =0.27, Rp = 0.25 dB 
ws =0.3r, As =50dB 
We provide a MATLAB script to design this filter. 


>> wp = 0.2*pi; ws = 0.3*pi; Rp = 0.25; As = 50; 
>> wsi = ws/delta_w+1; 

>> deltai = (10^(Rp/20)-1)/(10°(Rp/20)+1); 

>> delta2 = (1*deltai)*(107(-45/20)); 

>> deltaH = max(deltai,delta2); deltaL = min(deltai,delta2); 
>> weights = [delta2/deltali 1]; 

>> deltaf = (ws-wp)/(2*pi); 

>> M = ceil((-20*1ogi0(sqrt(deltai*delta2))-13)/(14.6*deltaf)*1) 
M = 43 

>> f = [0 wp/pi ws/pi 11; 

>>m= [1 1 0 0]; 

>> h = remez(M-1,f,m,weights); 

>> [db,mag,pha,grd,w] = freqz m(h,[1]); 

>> delta w = 2*pi/1000; 

>> Asd = -max(db(wsi:1:501)) 

Asd = 47.8562 

>> M = M+1; 

>> h = remez(M-1,f,m,weights); 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 

>> Asd = -max(db(wsi:1:501)) 

Asd = 48.2155 

>> M = M+1; 

>> h = remez(M-1,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz m(h,[1]); 
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>> Asd = -max(db(wsi:1:501)) 

Asd = 48.8632 

>> M = Mtl; 

>> h = remez(M-1,f,m,weights) ; 

>> [db,mag,pha,grd,w] = freqz_m(h, [1]); 
>> Asd = -max(db(wsi:1:501)) 

Asd = 49.8342 

>> M = Mti; 

>> h = remez(M-1,f,m,weights); 

>> (db,mag,pha,grd,w] = freqz m(h, (13); 
>> Asd = -max(db(wsi:1:501)) 

Asd = 51.0896 

>> M 

M = 47 


Note that we stopped the above iterative procedure when the computed stop- 
band attenuation exceeded the given stopband attenuation Az, and the optimal 
value of M was found to be 47. This value is considerably lower than the window 
design techniques (M = 61 for a Kaiser window) or the frequency sampling tech- 
nique (M = 60). In Figure 7.35 we show the time- and the frequency-domain 
plots of the designed filter along with the error function in both the passband 
and the stopband to illustrate the equiripple behavior. 
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FIGURE 7.35 Plots for equiripple lowpass FIR filter in Example 7.23 
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O EXAMPLE7.24 Let us design the bandpass filter described in Example 7.10 using the Parks- Actual impulse Response Magnitude Response in dB 


McClellan algorithm. The design parameters are: 








wis = 0.20 Rp =14B 

wip = 0.35" = E 

Wop = 0.657 Š 

; A, = 60 db 

Wes = 0.87 

0 0.2 0.35 0.65 0.8 1 
Solution The following MATLAB script shows how to design this filter. frequency in pi units 
x10? Weighted Error 
>> wsi = 0.2*pi; wpi = 0.35*pi; wp2 = 0.65*pi; ws2 = 0.8*pi; 1.0575 


>> wsii = floor(wsi/delta w)*1; 

>> Rp = 1.0; As = 60; 

>> deltat = (4107 (Rp/20)~1)/(107 (Rp/20) +1) ; = s ! 
>> delta2 = (i*deltai)*(107(-4As/20)); JB = OW Pod: 
>> deltaH = max(deltai,delta2); deltaL = min(deltai,delta2) ; m - 
>> weights = [1 delta2/deltai 1]; 





>> delta f =min((ws2-wp2)/(2*pi), (wpi-ws1)/(2*pi)); 0 | d 1 d 

dum ceil((-20*1ogi0(sqrt(deltai*delta2))-13)/(14.6*delta f)*1) o ^ 02035 06508 1 710575 02 035 065 08 1 
frequency in pi units frequency in pi units 

>> f = [0 wsi/pi wpi/pi wp2/pi ws2/pi 1]; 

>> m= (001100); FIGURE 7.36 Plots for equiripple bandpass FIR filter in Example 7.24 

>> h = remez(M-1,f,m,weights) ; \ 

>> [db,mag,pha,grd,w] = freqz m(h,[1]); 

>> delta_w=2*pi/1000; D EXAMPLE 7.25 Design a highpass filter that has the following specifications: 


>> Asd = -max(db(1:1:wsii)) 


Asd = 56.5923 ws = 0.67, A, = 50 dB 


>> M = Mti; wp = 0.757, Rp =0.5 dB 
>> h = remez(M-1,f,m, weights) ; 
>> [db,mag,pha,grd,w] = freqz m(h,[1]); Solution Since this is a highpass filter, we must ensure that the length M is an odd 
>> Asd = -max(db(1:1:ws1/delta_w)) number. This is shown in the following MATLAB script. 
Asd = 61.2818 
>> M = Mti; >> ws = 0.6*pi; wp = 0.75*pi; Rp = 0.5; As = 50; 
>> h = remez(M-1,f,m,weights) ; >> deltai = (107(Rp/20)-1)/(107 (Rp/20) +1) ; 
>> [db,mag,pha,grd,w] = freqz m(h,[1]); >> delta2 = (i*deltai)*(10^(-4s/20)); 
>> Asd = -max(db(1:1:wsi/delta w)) >> deltaH = max(deltai,delta2); deltaL = min(deltai,delta2); 
Asd = 60.3820 >> weights = [1 delta2/deltai]; 
>> M = MH; >> deltaf = (wp-ws)/(2*pi); 
>> h = remez(M-1,f,m,weights) ; >> M = ceil ((-20#10g10(sqrt (deltai*delta2))-13)/(14.6+deltaf)+1) ; 
>> [db,mag,pha,grd,w] = fregz m(h,[1)); X M must be odd 
>> Asd = -max(db(1:1:wsi/delta_w)) >> M = 2#floor(M/2)+1 
Asd = 61.3111 M= 27 
>> M >> f = [0 ws/pi wp/pi 1]; 
M = 31 >> m= [00 1 1); 
>> h = remez(M-1,f,m, weights); 
The optimal value of M was found to be 31. The time- and the frequency-domain >> [db,mag,pha,grd,w] = freqz_m(h,[1]); 
plots of the designed filter are shown in Figure 7.36. n >> delta w = 2*pi/1000; wei=ws/delta_w; wpi = wp/delta w; 
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>> Asd = -max(db(1:1:wsi)) 

Asd = 49.5918 

>> M = M42; % M must be odd 

>> h = remez(M-1,f,m,weights); 

>> [db,mag,pha,grd,w] = freqz_m(h,(1]); 
>> Asd = -max(db(1:1:wsi)) 

Asd = 50.2253 

>> M 

M= 29 


Note also that we increased the value of M to maintain its odd value. The 
optimum M was found to be 37. The time- and the frequency-domain plots of 
the designed filter are shown in Figure 7.37. a 


O EXAMPLE 7.26 In this example we will design a “staircase” filter, which has three bands with 
different ideal responses and different tolerances in each band. The design spec- 
ifications are 


Band-1: 0<w<0.3%, Ideal gain = 1, Tolerance 6; = 0.01 
Band-2: 0.47 <w<0.7n, Ideal gain = 0.5, Tolerance 62 = 0.005 
Band-3: 0.8% <w<7, Ideal gain = 0, Tolerance 63 = 0.001 
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FIGURE 7.37 Plots for equiripple highpass FIR filter in Example 7.25 
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Solution The following MATLAB script describes the design procedure. 


wi=0; w2=0.3*pi; deltai-0.01; 

w3=0.4*pi; w4=0.7#pi; delta2=0.005; 
w5=0.8*pi; w6=pi; delta3=0.001; 
weights=[delta3/deltal delta3/delta2 1]; 
delta fe-min((w3-w2)/(2*pi), (w5-w3)/(Q*pi)); 
Meceil((-20*1og10(sqrt (deltai*delta2))-13)/(14.6*delta f)*1) 
= 43 

f=[0 w2/pi w3/pi w4/pi w5/pi 1]; 

me[i 1 0.5 0.5 0 0]; 
h=remez(M-1,f,m,weights) ; 

[db mag, pha,grd,w]=freqz_m(h, [1]); 
delta_w=2*pi/680; 

Asd=-max (db(u5/delta w*10:1:341)) 

Asd = 56.2181 


VV VV VR M NNNM 


The optimum value of M was found at M — 49. 


> M= 49; 

> heremez(M-1,f,m,weights) ; 

> [db,mag,pha,grd,w] =freqz_m(h, [1]); 
> Asd=-max(db(w5/delta_w+i0:1:341)) 
Asd = 60.6073 


The time- and the frequency-domain plots of the designed filter are shown in 
Figure 7.38. o 


O  EXAMPLE727 In this example we will design a digital differentiator with different slopes in 
each band. The specifications are 
Band-1: 0<w<0.27, Slope = 1 sam/cycle 
Band-2: 0.44 <w €0.6m, Slope = 2 sam/cycle 
Band-3: 0.8% <w<7, Slope = 3 sam/cycle 


Solution We need desired magnitude response values in each band. These can be ob- 
tained by multiplying band-edge frequencies in cycles/sam by the slope values 
in sam/cycle 

Band-dl: O<f<0.1, Slope=1sam/cycle>0.0< |H| < 0.1 
Band-2: 0.2<f<0.3, Slope = 2 sam/cycle = 0.4 < |H| < 0.6 
Band-3: 0.4< f <0.5, Slope — 3 sam/cycle > 1.2 € |H] € i5 


Let the weights be equal in all bands. The MATLAB script is: 


E eee 
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FIGURE 7.38 Plots for equiripple staircase FIR filter in Example 7.26 FIGURE 7.39 Plots of the differentiator in Ezample 7.27 
>> f = [0 0.2 0.4 0.6 0.8 1]; % in w/pi unis \ >> [db,mag,pha,grd,w] = freqz_m(h, [1]); 
>> m= [0,0.1,0.4,0.6,1.2,1.5]; % magnitude values >> figure(1); subplot(1,1,1) 
>> h = remez(25,f,m, differentiator’); >> subplot (2,1,1); stem([0:50],h); title( Impulse Response’); 
>> [db,mag,pha,grd,w] = freqz.n(h, [1]); >> xlabel(’n’); ylabel(’h(n)’); axis([0,50,-0.8,0.8]) 
>> figure(1); subplot(1,1,1) >> set(gca, XTickMode’ , 'manual' ,’XTick’, [0,50]) 
>> subplot (2,1,1); stem([0:25],h); title(’ Impulse Response?) ; >> set(gca, YTickMode’ ,’manual’,’YTick’, [-0.8:0.2:0.8]); 
>> xlabel(’n’); ylabel(’h(n)’); axis([0,25,-0.6,0.6]) >> subplot(2,1,2); plot(w/pi,mag); title(’Magnitude Response’) 
>> set(gca, "YTickMode' , ’manual’, ’XTick’ , [0,25]) >> xlabel('frequency in pi units’); ylabelC IBI» 
>> set(gca, ¥TickMode’ ,'manual' ," YTick', [-0.6:0.2:0.6)) ; >> set(gca,'XTickMode','manual', ?"XTick', [0,f ,1D 
>> subplot(2,1,2); plot(w/(2*pi),mag); title('Magnitude Response’) >> set(gca, YTickMode’, ’manual’, ^"YTick! , [0,1]);grid 
>> xlabel('Normalized frequency f’); ylabelC IHI?) : 
>> set(gca, XTickMode’ , manual’, *XTick’ ,£/2) The plots of this Hilbert transformer are shown in Figure 7.40. [n] 


>> set(gca,'YTickMode' ,'manual',"YTick', [0,0.1,0.4,0.6,1.2,1.5)) ; grid 
The frequency-domain response is shown in Figure 7.39. ü 
O EXAMPLE 728 Finally, we design a Hilbert transformer over the band 0.057 < w < 0.957. 


Solution Since this is a wideband Hilbert transformer, we will choose an odd length for 
our filter (i.e., a Type-3 filter). Let us choose M = 51. 


>> f = [0.05,0.95]; m = (1 11; 
>> h = remez(50,f,m,'hilbert!); 
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b. Show that the above H, (w) can be further expressed as 


L 
w A M 
H, (w) = seg tinea L=>- 1 
where 5(n) is derived from b (n). 
The Type-3 linear-phase FIR filter is characterized by 





h(n) = -h(M —1-n), 0n € M - 1, M odd 
a. Show that its amplitude response Hr (w) is given by 


(M-1/2 
H, (w) = Y c (n) sinun 
n=1 
where coefficients {c(n)} are obtained from h (n). 
b. Show that the above H, (w) can be further expressed as 
L 
H, (w) = sinw V ^ č(n) cosum, L- 


n=0 





M-3 
2 
frequency in pi units 


FIGURE 7.40 Plots of the Hilbert transformer in Ezample 7.28 where é(n) is derived from c(n). 


P7.4 The Type-4 linear-phase FIR filter is characterized by 
h(n) = -h(M —-1-n), 0€ n € M — 1, M even 


PROBLEMS a. Show that its amplitude response H, (w) is given by 
M/2 i 
P7.1 The Type-l linear-phase FIR filter is characterized by Hele) = È dlp) t (= E 2 


h(n) -h(M—-1-n), 0€n€ M — 1, M odd where coefficients (d (n)) are obtained from h(n). 


Show that its amplitude response H, (w) is given by b. Show that the above H, (w) can be further expressed as 
M-1 


L 
"^ 7 _M 
3 H, (w) =sin 5 1 d(n)cosun, L= us 


n=0 


L 
H, (w) = J a(n) coswn, L= 


n=0 
where coefficients {a (n)} are obtained from h (n): 


where d (n) is derived from d (n). 
P7.2 The Type-2 linear-phase FIR filter is characterized by 


P7.5 Write a MATLAB function to compute the amplitude response Hr (w), given a linear-phase 
h(n) =h(M—-1-n),0<n<M-1, M even impulse response h (n). The format of this function should be 
a. Show that its amplitude response H, (w) is given by function [Hr,w,P,L] = Ampl_Res(h); 


% ^ 


M/2 
H. w) = Y bln 008 [o ( cy 3)) 4 function [Bru P,L] = Ampl Res(h) 
e 2 % Computes Amplitude response Hr(w) and its polynomial P of order L, 


% given a linear-phase FIR filter impulse response h. 


where coefficients (a (n)) are obtained from A (n). X The type of filter is determined automatically by the subroutine. 
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P7.6 


P7.7 


P7.8 


P7.9 


P7.10 
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% 

% Hr = Amplitude Response 

% w = frequencies between [0 pi] over which Hr is computed 
X P = Polynomial coefficients 

X L = Order of P 

% h = Linear Phase filter impulse response 


The subroutine should first determine the type of the linear-phase FIR filter and then use 


the appropriate Hr. Types function discussed in the chapter. It should also check if the given 


h (a) is of a linear-phase type. Check your subroutine on sequences given in Examples 7.4 
through 7.7. 


If H (z) has zeros at 
j 1 _; E 
z =r, z--e 39^ gare, m= i: 
T r 


show that H (z) represents a linear-phase FIR filter. 


Design a bandstop filter using the Hanning window design technique. The specifications are 


lower stopband edge: 0.47 
A, = 40 dB 
upper stopband edge: 0.67 


lower passband edge: 0.37 
Rp = 0.5 dB 
upper passband edge: 0.77 


Plot the impulse response and the magnitude response (in dB) of the designed filter. 


Design a bandpass filter using the Hamming window design technique. The specifications are 


lower stopband edge: 0.37 
upper stopband edge: 0.67 
lower passband edge: 0.47 


A, = 50 dB 


Rp = 0.5 dB 
upper passband edge: 0.57 


Plot the impulse response and the magnitude response (in dB) of the designed filter. 
Design a highpass filter using the Kaiser window design technique. The specifications are 


stopband edge: 0.41, A, = 60 dB 
passband edge: 0.67, Ry =0.5 dB 


Plot the impulse response and the magnitude response (in dB) of the designed filter. 


We wish to use the Kaiser window method to design a linear-phase FIR digital filter that 
meets the following specifications: 


0 « |H (e)| < 0.01, 0 <w < 0.259 
0.95 < |H (e%)| < 1.05, 0.357 <w < 0.657 
ox|H(e")| <0.01, 0.757 <w S 


Determine the minimum-length impulse response h (n) of such a filter. Provide a plot 
containing subplots of the amplitude response and the magnitude response in dB. 


P7.11 Following the procedure used in this chapter, develop the following MATLAB functions to 


design FIR filters via the Kaiser window technique. These functions should check for the 
valid band-edge frequencies and restrict the filter length to 255. 


a. Lowpass filter: The format should be 


function [h,M] = kai lpf(wp,ws,As); 
% [h,M] = kai lpf(wp,ws,As); 
X Low-Pass FIR filter design using Kaiser window 


h = Impulse response of length M of the designed filter 
M - Length of h which is an odd number 
wp = Pass-band edge in radians (0 < wp < ws < pi) 
ws = Stop-band edge in radians (0 < wp < ws < pi) 
% As = Stop-band attenuation in dB (As > 0) 


- b. Highpass filter: The format should be 


function [h,M) = kai hpf(ws,wp,As); 
X [h,M] = kai hpf(ws,wp,As); 
% HighPass FIR filter design using Kaiser window 
% 
% h= Impulse response of length M of the designed filter 
% M = Length of h which is an odd number 

ws = Stop-band edge in radians (0 < wp < ws < pi) 
Pass-band edge in radians (0 < wp < ws < pi) 
Stop-band attenuation in dB (As > 0) 


war 
ad 
nA 


c. Bandpass filter: The format should be 


function h, M] = kai_bpf(wel,wp1,wp2,ws2,As); 

% [h,M] = kai_bpf(ws1,wp1,wp2,ws2,As) ; 

% Band-Pass FIR filter design using Kaiser window 
* 

% h= Impulse response of length M of the designed filter 
% M= Length of h which is an odd number 

% wei = Lower stop-band edge in radians 

% wpi = Lower pass-band edge in radians 

% wp2 = Upper pass-band edge in radians 

% ws2 = Upper stop-band edge in radians 

p O < wsi < wpl < wp2 < ws2< pi 

X As = Stop-band attenuation in dB (As > 0) 


d. Bandstop filter: The format should be 
function [h,M] = kai bsf(wpi,ws1,ws2,wp2,Às); 


% Ub, = kai bsf(wpil,wsi,ws2,wp2,As); 
(4 Band-Pass FIR filter design using Kaiser window 


P7.12 


P7.13 


P7.14 
P7.15 
P7.16 


P7.17 





% h = Impulse response of length M of the designed filter 
% M = Length of h which is an odd number 


X wpi = Lower stop-band edge in radians 
% wei = Lower pass-band edge in radians 
4, ws2 = Upper pass-band edge in radians 
% wp2 = Upper stop-band edge in radians 


* O < wpi < ws1 < ws2 < wp2 < pi 
% As = Stop-band attenuation in dB (As > 0) 


You can now develop similar functions for other windows discussed in this chapter. 


Design the staircase filter of Example 7.26 using the Blackman window approach. The 
specifications are 


Band-1: 0<w<0.3r, Ideal gain = 1, 64 = 0.01 
Band-2: 0.4m <w € 0.7z, Ideal gain=0.5, 62 — 0.005 


Band-3: 0.8% <w <7, Ideal gain = 0, 63 = 0.001 


Compare the filter length of this design with that of Example 7.26. Provide a plot of the 
magnitude response in dB. 


Consider an ideal lowpass filter with the cutoff frequency we = 0.37. We want to 
approximate this filter using à frequency sampling design in which we choose 40 samples. 


a. Choose the sample at we equal to 0.5 and use the naive design method to compute A (n). 
Determine the minimum stopband attenuation. 


b. Now vary the sample at w: and determine the optimum value to obtain the largest 
minimum stopband attenuation. 


c. Plot the magnitude responses in dB of the above two designs in one plot and comment 
on the results. 


Design the bandstop filter of Problem 7.7 using the frequency sampling method. Choose the 
order of the filter appropriately so that there is one sample in the transition band. Use 
optimum value for this sample. 


Design the bandpass filter of Problem 7.8 using the frequency sampling method. Choose the 
order of the filter appropriately so that there are two samples in the transition band. Use 
optimum values for these samples. 


Design the highpass filter of Problem 7.9 using the frequency sampling method. Choose the 
order of the filter appropriately so that there are two samples in the transition band. Use 
optimum values. 


We want to design a narrow bandpass filter to pass the center frequency at wo = 0.57. The 
bandwidth should be no more than 0.17. 


a. Use the frequency sampling technique and choose M so that there is one sample in the 
transition band. Use the optimum value for transition band samples and draw the frequency 
sampling structure. 


b. Use the Kaiser window technique so that the stopband attenuation is the same as that of 
the above frequency sampling design. Determine the impulse response h (n) and draw the 
linear-phase structure. 


c. Compare the above two filter designs in terms of their implementation and their filtering 
effectiveness. 
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P7.18 


P7.19 


P7.20 


P7.21 


P7.22 


The frequency response of an ideal bandpass filter is given by 


0, 0 < lo] < 2/3 
Ha (e^) = 1, 2/3<|wl < 20/3 
0, 27/3 <| € v 


a. Determine the coefficients of a 25-tap filter based on the Parks-McClellan algorithm with 
stopband attenuation of 50 dB. The designed filter should have the smallest possible 
transition width. 

b. Plot the amplitude response of the filter using the function developed in Problem 7.5. 
Consider the bandstop filter given in Problem 7.7. 

a. Design a linear-phase bandstop FIR filter using the Parks-McClellan algorithm. Note 
that the length of the filter must be odd. Provide a plot of the impulse response and the 
magnitude response in dB of the designed filter. 


b. Plot the amplitude response of the designed filter and count the total number of extrema 
in the stopband and passbands. Verify this number with the theoretical estimate of the 
total number of extrema. 

c. Compare the order of this filter with those of the filters in Problems 7.7 and 7.14. 

d. Verify the operation of the designed filter on the following signal: 

"n 


z(n) = 5 — 5cos ( 2 


Js 0 <n < 300 


Using the Parks-McClellan algorithm, design a 25-tap FIR differentiator with slope equal to 
1 sample/cycle. 

a. Choose the frequency band of interest between 0.17 and 0.97. Plot the impulse response 
and the amplitude response. 


b. Generate 100 samples of the sinusoid 
z(n)-3sin(025-n) n=0,..., 100 


and process through the above FIR differentiator. Compare the result with the theoretical 
“derivative” of z (n). Note: Don't forget to take the 12-sample delay of the FIR filter into 
account. 

Design a lowest-order equiripple linear-phase FIR filter to satisfy the specifications given in 
Figure 7.41. Provide a plot of the amplitude response and a plot of the impulse response. 

A digital signal z (n) contains a sinusoid of frequency 7/2 and a Gaussian noise w (n) of 
zero mean and unit variance; that is, 


z (n) = 200577 + w (n) 


We want to filter out the noise component using a 50th-order causal and linear-phase FIR 
filter. 

a. Using the Parks-McClellan algorithm, design a narrow bandpass filter with passband 
width of no more than 0.027 and stopband attenuation of at least 30 dB. Note that no 
other parameters are given, and you have to choose the remaining parameters for the remez 
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FIGURE 7.41 Filter specification for Problem 7.21 


function to satisfy the requirements. Provide a plot of the log-magnitude response in dB of 
the designed filter. 


b. Generate 200 samples of the sequence z (n) and process through the above filter to 
obtain the output y (n). Provide subplots of z (n) and y (n) for 100 € n < 200 on one plot 
and comment on your results. 


P7.23 Design an equiripple digital Hilbert transformer for the following specifications: 


passband: 0.1m € |w| < 0.57 ripple 6, = 0.01 
stopband: 0.57 < |w| € v ripple 62 = 0.01 


Plot the amplitude response over —7 Sw € T. 
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IIR FILTER DESIGN ^^ 


IIR filters have infinite-duration impulse responses, hence they can be 
matched to analog filters, all of which generally have infinitely long im- 
pulse responses. Therefore the basic technique of IIR filter design trans- 
forms well-known analog filters into digital filters using complex-valued 
mappings. The advantage of this technique lies in the fact that both 
analog filter design (AFD) tables and the mappings are available exten- 
sively in the literature. This basic echnique is called the A/D (analog- 
to-digital) filter transformation. However, the AFD tables are available 
only for lowpass filters. We also want to design other frequency-selective 
filters (highpass, bandpass, bandstop, etc.). To do this, we need to apply 
frequency-band transformations to lowpass filters. These transformations 
are also complex-valued mappings, and they are also available in the lit- 
erature. There are two approaches to this basic technique of IIR filter 
design: 


Approach 1: 















Design analog Apply freq. band Apply filter Desired IIR 
__,| transformation |——»| transformation | — 
lowpass filter css ps filter 
Approach 2: 
Design analo Apply filter Apply freq. band Desired IIR. 
E |. | transformation | —4| transformation 
lowpass filter Sp cid. filter 


The first approach is used in MATLAB to design IIR filters. A straight- 
forward use of these MATLAB functions does not provide any insight into 
the design methodology. Therefore we will study the second approach be- 
cause it involves the frequency-band transformation in the digital domain. 
Hence in this IIR filter design technique we will follow the following steps: 
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e Design analog lowpass filters. 

e Study and apply filter transformations to obtain digital lowpass 
filters. 

e Study and apply frequency-band transformations to obtain other 
digital filters from digital lowpass filters. 


The main problem with these approaches is that we have no control 
over the phase characteristics of the IIR filter. Hence IIR filter designs 
will be treated as magnitude-only designs. More sophisticated techniques, 
which can simultaneously approximate both the magnitude and the phase 
responses, require advanced optimization tools and hence will not be cov- 
ered in this book. 

We begin with a discussion on the analog filter specifications and the 
properties of the magnitude-squared response used in specifying analog 
filters. This will lead us into the characteristics of three widely used ana- 
log filters, namely, Butterworth, Chebyshev, and Elliptic filters. We will 
then study transformations to convert these prototype analog filters into 
different frequency-selective digital filters. Finally, we will conclude this 
chapter with a discussion on the merits and comparisons of FIR and IIR 
digital filters. 


SOME PRELIMINARIES 


We discuss two preliminary issues in this section. First, we consider the 
magnitude-squared response specifications, which are more typical of ana- 
log (and hence of IIR) filters. These specifications are given on the relative 
linear scale. Second, we study the properties of the magnitude-squared re- 





sponse. 
RELATIVE Let Ha(j®) be the frequency response of an analog filter. Then the lowpass 
LINEAR filter specifications on the magnitude-squared response are given by 
SCALE 
Q2 
zr sa gmf s me, 
1 (8.1) 
0 < |Ha (52)? < Q, < JA 


273? 


where € is a passband ripple parameter, Np is the passband cutoff fre- 
quency in rad/sec, A is a stopband attenuation parameter, and Qs is the 
stopband cutoff in rad/sec. These specifications are shown in Figure 8.1, 
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FIGURE 8.1 Analog lowpass filter specifications 


from which we observe that |H, G0)? must satisfy 





; 1 
(Halj)? = 77g st9-9, 

poma (8.2) 
HGA = Gy at N=A 


The parameters e and A are related to parameters Ry and As, re- 
spectively, of the dB scale. These relations are given by 


Rp = —101logi;o aie => e = y 10/10 — 1 (8.3) 
and 
A, = —10log,o 4i = A = 104/20 (8.4) 


The ripples, 5; and 69, of the absolute scale are related to € and A by 


1-6 | [1 02/0 
1-ói ae 1-6; 








and 
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PROPERT IES Analog filter specifications (8.1), which are given in terms of the magni- — 


"C2 A - 
OF |H4(j$1)| tude-squared response, contain no phase information. Now to evaluate th 
s-domain system function H, (s), consider 


H, (jQ) = H«(s)1,.jn 
Then we have 

iH, (jQ)? = Halj) Hi (0) = H.(j9) H.(—jQ) = Ha(s) H«(75)],—;n 
or 


H,(s)Ha(—s) = |H. GO) (8.5) 


n=s/j 


Therefore the poles and zeros of the magnitude-squared function are dis- 
tributed in a mirror-image symmetry with respect to the jì? axis. Also for 
real filters, poles and zeros occur in complex conjugate pairs (or mirror- 
image symmetry with respect to the real axis). A typical pole-zero pat- 
tern of H,(s)Ha(—s) is shown in Figure 8.2. From this pattern we can 
construct H,(s), which is the system function of our analog filter. We 
want H,(s) to represent a causal and stable filter. Then all poles of H,(s) 
must lie within the left half-plane. Thus we assign all left-half poles of 
H,(s)Ha(—s) to Ha(s). However, zeros of Ha(s) can lie anywhere in the 
s-plane. Therefore they are not uniquely determined unless they all are 
on the j axis. We will choose the zeros of Ha(s)Ha(—s) lying inside or 
on the j(? axis as the zeros of Ha(s). The resulting filter is then called a 
minimum-phase filter. 





FIGURE 8.2 Typical pole-zero pattern of Ha(s)Ha(—s) 


NN 


304 Chapter 8 @ IIR FILTER DESIGN 


CHARACTERISTICS OF PROTOTYPE ANALOG FILTERS 
_ 


IIR filter design techniques rely on existing analog filters to obtain digital 
filters. We designate these analog filters as prototype filters. Three pro- 
totypes are widely used in practice. In this section we briefly summarize 
the characteristics of the lowpass versions of these prototypes: Butter- 
worth lowpass, Chebyshev lowpass (Type I and II), and Elliptic lowpass. 
Although we will use MATLAB functions to design these filters, it is neces- 
sary to learn the characteristics of these filters so that we can use proper 
parameters in MATLAB functions to obtain correct results. 





BUTTER- This filter is characterized by the property that its magnitude response is 
WORTH flat in both passband and stopband. The magnitude-squared response of 
LOWPASS an Nth-order lowpass filter is given by 
FILTERS 

Ig. G9) = (8.6) 


1 
QV 
Et (a) 


where N is the order of the filter and N is the cutoff frequency in rad/sec. 
The plot of the magnitude-squared response is shown below. 


HUI N=% 





From this plot we can observe the following properties: 


e at Q — 0, |Ha(j0)|? = 1 for all N. 

e at (à — Q,, |Ha (GN)? = i for all N, which implies a 3 dB attenu- 
ation at Ne- 

e |H,() |? is a monotonically decreasing function of 2. 

e. |i, Go) approaches an ideal lowpass filter as N — oo. 

e |H,(jQ) |? is marimally flat at Q = 0 since derivatives of all orders 
exist and are equal to zero. 
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To determine the system function H, (s), we put (8.6) in the form of (8.5) 


to obtain 
; 1 (jay 
Ho(s)Ha(—s) = VIGO), = 7-3 = Bn Gn 
+ (i) 
je 
(8.7) 


The roots of the denominator polynomial (or poles of Ha(s)H. a(—5)) from 
(8.7) are given by 


pe = (-1) 2 (jN) = Quei i GEN D, k-0,1,...,2N -1 (88) 


An interpretation of (8.8) is that 


e there are 2N poles of H,(s)Ha(—s), which are equally distributed 
on a circle of radius 9, with angular spacing of 7/N radians, 

e for N odd the poles are given by px = Q,ei*r/N, k —0,1..., 
2N - 1, 

e for N even the poles are given by pk = Quei Gh +4), k= 
0,1,..., 2N — 1, 

e the poles are symmetrically located with respect to the jQ axis, 
and 

e a pole never falls on the imaginary axis, and falls on the real axis 
only if N is odd. 
As an example, poles of third- and fourth-order Butterworth filters are 
shown in Figure 8.3. 

A stable and causal filter H,(s) can now be specified by selecting 
poles in the left half-plane, and H,(s) can be written in the form 


ay 
I. (s—px) 


LHP poles 


H,(s) = 


(8.9) 





FIGURE 8.3 Pole plots for Butterworth filters 
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[| EXAMPLE 8.1 Given that |Ha(j)|? = De determine the analog filter system function 
H,(s). 
Solution From the given magnitude-squared response, 
S oO d eee eee 
|Ha(3Q)| = 14-6405 a B 2 2(3) 
(ss) 


Comparing this with expression (8.6), we obtain N = 3 and Q. = 0.5. The poles 
of Ha(s)Ha(—s) are as shown in Figure 8.4. 





—0.433, 7’ 
Lp -7 ps 


EN 1 
pa 
N=3 


FIGURE 8.4 Pole plot for Example 8.1 


Hence 
03 
H.(j2) = ———É—c—————Á 
69) = Gae- sss — s) 
" 1/8 
~ (s +0.25 — j0.433)(s + 0.5)(s + 0.25 + 70.433) 
= 0.125 - 
~ (s-4-0.5)(s? + 0.5s + 0.25) 
MATLAB MATLAB provides a function called [z,p,k] *buttap(N) to design a nor- 
IMPLEMEN- malized (i.e., €), = 1) Butterworth analog prototype filter of order N, 
TATION which returns zeros in z array, poles in p array, and the gain value k. 


However, we need an unnormalized Butterworth filter with arbitrary Ne. 
From Example 8.1 we observe that there are no zeros and that the poles 
of the unnormalized filter are on a circle with radius 2, instead of on a 
unit circle. This means that we have to scale the array p of the normal- 
ized filter by OQ, and the gain k by NN. In the following function, called 
U_buttap(N,Omegac), we design the unnormalized Butterworth analog 
prototype filter. 


NEN (i iL Le 
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function [b,a] = u_buttap(N,Omegac); 
% Unnormalized Butterworth Analog Lowpass Filter Prototype 


% [b,a] = u buttap(N,Onegac) ; 


* b = numerator polynomial coefficients of Ha(s) 
% a = denominator polynomial coefficients of Ha(s) 
% N = Order of the Butterworth Filter 


% Omegac = Cutoff frequency in radians/sec 
* 
[z,p,k)] = buttap(N); 

p = p*Omegac; 

k = k*Ümegac^N; 

B = real(poly(z)); 

bO = K; 

b = k*B; 

a = real(poly(p)); 


The above function provides a direct form (or numerator-denominator) 
structure. Often we also need a cascade form structure. In Chapter 6 we 
have already studied how to convert a direct form into a cascade form. 
The following sdir2cas function describes the procedure that is suitable 
for analog filters. 


function [C,B,A] = sdir2cas(b,a); 
* DIRECT-form to CASCADE-form conversion in s-plane 


% [C,B,A] = sdir2cas(b,a) 

% C = gain coefficient 

% B=K by 3 matrix of real coefficients containing bk's 
X A*K by 3 matrix of real coefficients containing ak's 
% b = numerator polynomial coefficients of DIRECT forn 
% a = denominator polynomial coefficients of DIRECT form 
* 

Na = length(a)-1; Nb = length(b)-1; 


% compute gain coefficient C 

bO = b(1); b = b/b0; 

a0 = a(1); a = a/a0; 

C = b0/a0; 

* 

% Denominator second-order sections: 
p= cplxpair(roots(a)); K = floor(Na/2); 


if K*2 == Na % Computation when Na is even 
A = zeros(K,3); 
for n=1:2:Na 


Arow = p(n:1:n*1,:); 

Arow = poly(Arow) ; 

A(fix((n*1)/2),:) = real(Arow); 
end 


a 
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EXAMPLE 8.2 





elseif Na == 1 % Computation when Na = 1 
A = (0 real(poly(p))]; 
"Y 


eise X Computation when Na is odd and > 1 
A = zeros(K*1,3); 
for n=1:2:2*K 
Arow = p(n:i:nt1,:2; 
Arow = poly(Arow); 
A(fix((n*1)/2),:) = real(Arow); 
end g 
A(K+1,:) = [0 real(poly(p(Na)))]; 
end 


% Numerator second-order sections: 

z = cplxpair(roots(b)); K = floor(Nb/2); 

if Nb == 0 % Computation when Nb = 0 
B = [0 0 poly(z)]; 


elseif K*2 == Nb % Computation when Nb is even 
B = zeros(K,3); 
for n=1:2:Nb 
Brow = z(n:1:n*1,:); 
Brow = poly (Brow) ; 
B(fix((n+1)/2),:) = real (Brow); 
end 


elseif Nb == 1 % Computation when Nb = 1 
B = [0 real(poly(2))]; 


else % Computation when Nb is odd and > 1 
B = zeros(K*1,3); 
for ns1:2:2*K 
Brow = z(n:1:n*1,:); 
Brow = poly (Brow) ; 
B(fix((n+1)/2),:) = real (Brow); 
end 
B(K+i,:) = [0 real(poly(z(Nb)))]; 
end 


Design & third-order Butterworth analog prototype filter with f), = 0.5 given 
in Example 8.1. 


MATLAB Script ————— 
>> N = 3; OmegaC = 0.5; 

>> [b,a] = u_buttap(N,Omegac) ; 

>> [C,B,A] = sdir2cas(b,a) 

C = 0.1250 

B=0 0 i 
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A = 1.0000 0.5000 0.2500 
0 1.0000 0.5000 


NS, 


The cascade form coefficients agree with those in Example 8.1. n 
DESIGN The analog lowpass filter is specified by the parameters Qp, Rp, Q,, and 
EQUATIONS A,. Therefore the essence of the design in the case of Butterworth filter 


is to obtain the order N and the cutoff frequency Qe, given these specifi- 
cations. We want 


e at Q = Mp, —10logyo |Ha(jM)|? = Rp or 


—101ogio 


1 
Far | = Rp 
1+ (2) 
Ne 
and 
e at Q — Q,, —101og;o |Ha (jN)? = As or 


m eens 
a, 2N 
t» (e) 
Solving these two equations for N and Qe, we have 


PN logio [(105»/19 — 1) / (104+/1° — 1)] 
B 21ogio (Qy/ Qs) 


In general, the above N will not be an. integer. Since we want N to be an 
integer, we must choose 


—10logio 


8 


21ogio (M%p/Ns) 


we UI (8.10) ` 


where the operation [z£] means “choose the smallest integer larger than 
z"—for example, [4.5] = 5. Since the actual N chosen is larger than 
required, specifications can be either met or exceeded either at 9, or at 
Q. To satisfy the specifications exactly at Op, 
NS NERA ee (8.11) 
2N f (19R»/10 -1) 


nn ry 
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C 
or, to satisfy the specifications exactly at Qs, 


dum serae ai 
2N / (104./10 ER 1) 


Oo EXAMPLE 8.3 Design a lowpass Butterworth filter to satisfy 


(8.12) 


Passband cutoff: Np = 0.27; Passband ripple: Rp = 7dB 
Stopband cutoff: Q, = 0.37 ; Stopband ripple: A. = 16dB 


Solution From (8.10) 


|| logio [(10°? — 1) / (10*5 - 1)] 


= | 2log, (0270.37) | omes 


To satisfy the specifications exactly at Qp, from (8.11) we obtain 
Q. = 0.27 
e 6 007-1) 
To satisfy specifications exactly at Qs, from (8.12) we obtain 
uc 0.37 


Now we can choose any 2, between the above two numbers. Let us choose 
Ne = 0.5. We have to design a Butterworth filter with N = 3 and Q. = 0.5, 
which we did in Example 8.1. Hence 


= 0.4985 








= 0.5122 


: 0.125 
H.G9) = (s + 0.5) (s? + 0.58 + 0.25) a 


MATLAB The above design procedure can be implemented in MATLAB as a simple 
IMPLEMEN- function. Using the U-buttap function, we provide the afd butt function 
TATION to design an analog Butterworth lowpass filter, given its specifications. 


This function uses (8.11). 


function [b,a] = afd butt(Wp,Ws,Rp,As); 
4 Analog Lowpass Filter Design: Butterworth 


% [b,a] = afd. butt (Vp, Ws, Rp, As) ; 

4 b = Numerator coefficients of Ha(s) 

% a= Denominator coefficients of Ha(s) 

* Wp = Passband edge frequency in rad/sec; Wp > 0 

% Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 
X Rp = Passband ripple in *dB; (Rp > 0) 
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% As = Stopband attenuation in *dB; (As > 0) 
1 
if Wp <= 0 
error(’Passband edge must be larger than 0’) 


end 
if Ws <= Wp 
error(’Stopband edge must be larger than Passband edge’) 
end 
if (Rp <= 0) | (As < 0) 
error(’PB ripple and/or SB attenuation ust be larger than 0?) 
end 


N = ceil((1ogi0( (107 (Rp/10)-1)/(107(4s/10)-1)))/ (2*10g10(Wp/Ws))); 
fprintf(’\n+*# Butterworth Filter Order = %2.0£ \n’,N) 

OmegaC = Wp/((10*(Rp/10)-1)~(1/(2#N))) ; 

(b, a] =u_buttap(N, Omegac) ; 


To display the frequency-domain plots of analog filters, we provide a 
function called freqs-m, which is a modified version of a function freqs 
provided by MATLAB. This function computes the magnitude response 
in absolute as well as in relative dB scale and the phase response. This 
function is similar to the freqz-m function discussed earlier. One main 
difference between them is that in the freqs_m function the responses are 
computed up to a maximum frequency Nmax- 


function [db,mag,pha,w] = freqs.n(b,a,wmax); 

% Computation of s-domain frequency response: Modified version 
% ————————————————————————————————————————————————————---— 
% [db,mag,pha,w] = freqs m(b,a,wmax); 

% db = Relative magnitude in db over [0 to wmax] 

% mag = Absolute magnitude over [0 to wmax] 

% pha = Phase response in radians over [0 to wmax] 

X w = array of 500 frequency samples between [0 to wmax) 

4 b = Numerator polynomial coefficents of Ha(s) 

* a = Denominator polynomial coefficents of Ha(s) 

% wmax = Maximum frequency in rad/sec over which response is desired 


w = [0:1:500] *umax/500; 

H = freqs(b,a,w); 

mag = abs(H); 

db = 20*10g10((magteps) /max(mag)) ; 
pha = angle(H); 


The impulse response A, (f) of the analog filter is computed using MAT- 
LAB's impulse function. 


Design the analog Butterworth lowpass filter specified in Example 8.3 using 
MATLAB. 


a A E a ——————— 
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Solution MATLAB Script LL ——————————————— 
>> Wp = 0.2*pi; Ws = 0.3*pi; Rp = 7; As = 16; 
>> Ripple = 10 ^ (-Rp/20); Attn = 10 ~ (-As/20) ; 
>> % Analog filter design: 
>> [b,a] = afd_butt(Wp,Ws,Rp,As); 
*** Butterworth Filter Order = 3 
>> % Calculation of second-order sections: 
>> [C,B,A] = sdir2cas(b,a) 
C = 0.1238 
B=0 0 1 
A = 1.0000 0.4985 0.2485 
0 1.0000 0.4985 
>> % Calculation of Frequency Response: 
>> [db,mag,pha,w] = freqs m(b,a,0.5*pi); 
>> % Calculation of Impulse response: 
>> [ha,x,t] = impulse(b,a); 
The system function is given by 
n=. AE 
a V) = 732 70.49855 + 0.2485) (s + 0.4985) 
This H, (s) is slightly different from the one in Example 8.3 because in that 
example we used 2, = 0.5, while in the afd_butt function 2, is chosen to satisfy 
the specifications at 9p. The filter plots are shown in Figure 8.5. o 
CHEBYSHEV There are two types of Chebyshev filters. The Chebyshev-I filters have 
LOWPASS equiripple response in the passband, while the Chebyshev-II filters have 
FILTERS equiripple response in the stopband. Butterworth filters have monotonic 
response in both bands. Recall our discussions regarding equiripple FIR 
filters. We noted that by choosing a filter that has an equiripple rather 
than a monotonic behavior, we can obtain a lower-order filter. Therefore 
Chebyshev filters provide lower order than Butterworth filters for the 
same specifications. i 
The magnitude-squared response of a Chebyshev-I filter is 
; 1 
HGD? = ———py (813) 
1+eT?} zi 
N Qe 
where N is the order of the filter, € is the passband ripple factor, which is 
related to Rp, and Ty (z) is the Nth-order Chebyshev polynomial given 
by 
N cos"! (x O<2<1 Q 
Ty (2) = cos (N co m )), OS where z = —— 
cosh (cosh™*(z)), 1«z«oo Re 
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FIGURE 8.5 Butterworth analog filter in Example 8.4 


The equiripple response of the Chebyshev filters is due to this polynomial 
Ty (z). Its key properties are (a) for0<z < 1, Tw (x) oscillates between 
—1 and 1, and (b) for 1 < x < 00, T(z) increases monotonically to oo. 
There are two possible shapes of | Ha( 3€), one for N odd and one for 
N even as shown below. Note that z = 2/2, is the normalized frequency. 


IH,UOM Hen 





nn 
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From the above two response plots we observe the following properties: 











e At z — 0 (or 2 2 0); 1H. G0)? =1 for N odd. 
IHOP = Lo for N even. 
e At z — 1 (or Q =N); HG)? = 1 E for all N. 
e For 0<2<1(or0<2<2,), |Ha(jz)|? oscillates between 1 and 
1 ; e 


e For z > 1 (or Q > Re), |H. Gaz)? decreases monotonically to 0. 
: 1 
e At z =2,, |Ha(jz)|? = A 


To determine a causal and stable H,(s), we must find the poles of 
H,(s)Ha(—s) and select the left half-plane poles for H,(s). The poles of 
H,(s)Ha(—s) are obtained by finding the roots of 


1472 Gk) 
c 


The solution of this equation is tedious if not difficult to obtain. It can be 
shown that if py =o%.+jO%, k=0,...,N—1 are the (left half-plane) 
roots of the above polynomial, then 


cy = (aM) cos f (+ aid 


wi -0..,N-1 (8.14) 
Qk = (bQ,) sin E+ | 
where 
a- 5 (Va Vie) b= 5 (Vat Via), and aie 
(8.15) 


These roots fall on an ellipse with major axis bQ. and minor axis ae. 
Now the system function is given by : 


K 


H,(s) = Me = px) 


(8.16) 
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where K is a normalizing factor chosen to make 


1, N odd 
H,(j0) = 1 bbs (8.17) 
Vite’ 


MATLAB provides a function called [z,p,k] -chebiap(N,Rp) to design 
a normalized Chebyshev-I analog prototype filter of order N and pass- 
band ripple Rp and that returns zeros in z array, poles in p array, and 
the gain value k. We need an unnormalized Chebyshev-I filter with arbi- 
trary Ne- This is achieved by scaling the array p of the normalized filter 
by Qe- Similar to the Butterworth prototype, this filter has no zeros. 
The new gain k is determined using (8.17), which is achieved by scaling 
the old k by the ratio of the unnormalized to the normalized denom- 
inator polynomials evaluated at s — 0. In the following function, called 
U.chbiap(N,Rp, Onegac?, we design an unnormalized Chebyshev-I analog 
prototype filter that returns Ha (s) in the direct form. 


function [b,a] = u_chbiap(N,Rp,Omegac) ; 

% Unnormalized Chebyshev-1 Analog Lowpass Filter Prototype 
Y -=-= 
% [b,a] = u_chbiap(N,Rp,Omegac) ; 


% b = numerator polynomial coefficients 
4 a = denominator polynomial coefficients 
* N = Order of the Elliptic Filter 


* Rp = Passband Ripple in dB; Rp > 0 
% Omegac = Cutoff frequency in radians/sec 


[z,p,k] = chebiap(N,Rp); 


a = real(poly(p)); 
aNn = a(N*1); 

p = p*Omegac; 

a = real(poly(p)); 
aNu = a(N*1); 

k = k*aNu/aNn; 

po = k; ! 

B = real(poly(z)); 

b = k*B; 


Given Qp, Qs, Rp, and Ag, three parameters are required to determine a 
Chebyshev-I filter: e, Qe, and N. From equations (8.3) and (8.4) we obtain 


e=Vi0R—1 and  A-1044/7» 


seseo o aoa a MMC 
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From the properties discussed above we have 


Ne = 0, and Qh = as (8.18) 
OQ 
The order N is given by 
g = (4 - 1) /e? (8.19) 
logio |g + V2? — 1 
N= oso (9+ Vi] (8.20) 


logo [n. +y- i| 
Now using (8.15), (8.14), and (8.16), we can determine H,(s). 


Design a lowpass Chebyshev-I filter to satisfy 
Passband cutoff: Np = 0.27 ; Passband ripple: Rp = 1dB 
Stopband cutoff: Q, = 0.37 ; Stopband ripple: A, = 16dB 


First compute the necessary parameters. 
e = V1001@) — 1 = 0.5088 
f, = Np = 0.20 Q. = = 1.5 


g= \(A?—1)/e = 12.2429 N= 


Now we can determine H.(s). 


a=}4+4/1+ 5 = 4.1702 
€ € 


a=05( Ya- x ia) = 0.3646 


A = 1015/79 = 6.3096 


b=05( Yat A ia) = 1.0644 
There are four poles for Ha(s): 


pos = (aM) cos [5 g z] + (be) sin |z ES z] = —0.0877 + j0.6179 


pia = (ahe) cos l5 + =| + (be) sin [5 + z] = —0.2117 + j0.2559 

Hence 
mosi i ni .  0.03829(— 0.89125 x .1103 x 3895) — 
als) = -3 = (8? 40.17545 + 0.3895) (s? + 0.42345 + 0.1103) 


[I(s- pe) 
k=0 
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Solution 


Note that the numerator is such that 


Ha(j0) = 


1 
vi¢+ 


= 0.89125 Dn 
e 


Using the U.chbiap function, we provide a function called afd.chbi to 
design an analog Chebyshev-II lowpass filter, given its specifications. This 
is shown below and uses the procedure described in Example 8.5. 


function [b,a] = afd_chb1(Wp,Ws,Rp,As) ; 
% Analog Lowpass Filter Design: Chebyshev~1 
* we een ee eo ee enn en nn oe on eee 
X [b,a] = afd chbi(Wp,Ws,Rp,As); 
% b = Numerator coefficients of Ha(s) 
% a= Denominator coefficients of Ha(s) 
% Wp = Passband edge frequency in rad/sec; Wp > 0 
% Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 
% Rp = Passband ripple in +dB; (Rp > 0) 
% As = Stopband attenuation in +dB; (As > 0) 
4 
if Wp <= 0 
error(’Passband edge must be larger than 0’) 
end 
if Ws <= Wp 
error(’Stopband edge must be larger than Passband edge’) 
end 
if (Rp <= 0) | (As < 0) 
error(’PB ripple and/or SB attenuation ust be larger than 0’) 
end 


ep = sqrt (10^ (Rp/10)-1) ; 

A = 10^(4s/20) ; 

OmegaC = Wp; 

OmegaR = Ws/Wp; 

g = sqrt(A*A-1)/ep; f 

N = ceil(logiO(g*sqrt(g*g-1)) /logi0(0megaR*sqrt (OmegaR*OmegaR-1))) ; 
fprintf(’\n*** Chebyshev-1 Filter Order = %2.0f \n’ n» 
{b,a]=u_chb1ap(N,Rp, QmegaC) ; 


Design the analog Chebyshev-I lowpass filter given in Example 8.5 using MAT- 
LAB. 


MATLAB Script 
>> Wp = 0.2*pi; Ws = O.3*pi; Rp = 1; As = 16; 

>> Ripple = 10 ^ (-Rp/20); Attn = 10 ^ (-As/20); 
>> % Analog filter design: 

>> [b,a] = afd_chbi(Wp,Ws,Rp,As); 

*** Chebyshev-1 Filter Order = 4 





nn Laan aay Seater 
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>> % Calculation of second-order sections: 
>> [C,B,A] = sdir2cas(b,a) 
C = 0.0383 
B=0 0 1 
A = 1.0000 0.4233 0.1103 

1.0000 0.1753 0.3895 
>> % Calculation of Frequency Response: 
>> (db,mag,pha,w] = freqs_m(b,a,0.5*pi) ; 
>> % Calculation of Impulse response: 
>> (ha,x,t] = impulse (b,a); 


The specifications are satisfied by a 4th-order Chebyshev-I filter whose system 
function is 


_ 0.0383 
Ha (s) = (s? + 42335 + 0.1103) (s? + 0.1753s + 0.3895) 
The filter plots are shown in Figure 8.6. a 


A Chebyshev-II filter is related to the Chebyshev-I filter through a 
simple transformation. It has a monotone passband and an equiripple 
stopband, which implies that this filter has both poles and zeros in the s- 
plane. Therefore the group delay characteristics are better (and the phase 
response more linear) in the passband than the Chebyshev-I prototype. If 


Magnitude Response Magnitude in dB 











06 02 0.3 0.5 30 0.2 0.3 . 0.5 
Analog frequency in pi units Analog frequency in pi units 
Phase Response Impulse Response 
0.2 
0.15 
290 
* 
= 0.05 
0 
: R -0.05 
E 02 03 0.5 o 10 20 30 40 
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FIGURE 8.6 Chebyshev-I analog filter in Example 8.6 
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we replace the term e?T2(Q0/Q.) in (8.13) by its reciprocal and also the 
argument z = 2/2, by its reciprocal, we obtain the magnitude-squared 
response of Chebyshev-II as 


1 


jay? = ——————— ——— 
HGD = are (LE 


(8.21) 


One approach to designing a Chebyshev-II filter is to design the corre- 
sponding Chebyshev-I first and then apply the above transformations. 
We will not discuss the details of this filter but will use a function from 
MATLAB to design a Chebyshev-II filter. 


MATLAB provides a function called (z,p,k]=cheb2ap(N,As) to design a 
normalized Chebyshev-II analog prototype filter of order N and passband 
ripple As and that returns zeros in z array, poles in p array, and the gain 
value k. We need an unnormalized Chebyshev-I filter with arbitrary Ne. 
This is achieved by scaling the array p of the normalized filter by Qe. Since 
this filter has zeros, we also have to scale the array z by Ne. The new gain 
k is determined using (8.17), which is achieved by scaling the old k by the 
ratio of the unnormalized to the normalized rational functions evaluated 
at s = 0. In the following function, called U-chb2ap(N,As,Omegac), we 
design an unnormalized Chebyshev-II analog prototype filter that returns 
H, (s) in the direct form. 


function [b,a] = u. chb2ap(N, As, Ümegac) ; 

X Unnormalized Chebyshev-2 Analog Lowpass Filter Prototype 
pQu——————————— —— nnn n= 
% [b,a] = u_chb2ap(N, As, Omegac) ; 


* b = numerator polynomial coefficients 
* a = denominator polynomial coefficients 
* N = Order of the Elliptic Filter 
* As = Stopband Ripple in dB; As > 0 
% Omegac = Cutoff frequency in radians/sec 
* 
[z,p,k] = cheb2ap(N,4s); 
a = real(poly(p)); 
aNn = a(N+1); 
p = p*Omegac; 
a = real(poly(p)); 
aNu = a(N+1); 
b = real(poly(z)); 
M = length(b); 
bNn = b(M); 
z = z*Ümegac; 
b = real(poly(z)); 
bNu = b(M); 


a RS 
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k = k*(aNu*bNn) / (aNn*bNu) ; 
bO = k; 
b = k*b; 


The design equations for the Chebyshev-II prototype are similar to 
those of the Chebyshev-I except that Q. = Q, since the ripples are in the 
stopband. Therefore we can develop a MATLAB function similar to the 
afd chb1 function for the Chebyshev-II prototype. 


function [b,a] = afd_chb2(Wp,Ws,Rp,As); 
% Analog Lowpass Filter Design: Chebyshev-2 


% [b,a] = afd_chb2(Wp,Ws,Rp, As); 
% b = Numerator coefficients of Ha(s) 
% a = Denominator coefficients of Ha(s) 
4 Wp = Passband edge frequency in rad/sec; Wp > 0 
4 Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 
4 Rp = Passband ripple in +dB; (Rp > 0) 
X As = Stopband attenuation in *dB; (As > 0) 
* 
if Wp <= 0 
error(’Passband edge must be larger than 0") 
end 
if Ws <= Wp 
error(’Stopband edge must be larger than Passband edge’) 
end 
if (Rp <= 0) | (As < 0) 
error('PB ripple and/or SB attenuation ust be larger than 0’) 
end 


ep = sqrt(10^ (Rp/10)-4) ; 

A = 107(4As/20); 

OmegaC = Wp; 

OmegaR = Ws/Wp; 

g = sqrt(A*A-1)/ep; 

N = ceil(logi0 (g*sqrt (g*g-1)) /1ogi0(OmegaR+sqrt (OmegaR*OmegaR-1))); 
fprintf(’\n*#* Chebyshev-2 Filter Order = 42.0f \n’,N) 
[b,a]=u_chb2ap(N,As,Ws) ; 


Design a Chebyshev-II analog lowpass filter to satisfy the specifications given 
in Example 8.5: 

Passband cutoff: Qp = 0.27; Passband ripple: Rp = 1dB 

Stopband cutoff: 2, = 0.37 ; Stopband ripple: A, = 16dB 


MATLAB Script 
>> Wp = 0.2*pi; Ws = 0.3*pi; Rp = 1; As = 16; 
>> Ripple = 10 ^ (-Rp/20); Attn = 10 ^ (-4s/20) ; 
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>> % Analog filter design: 

>> [b,a] = afd chb2(Wp,Ws,Rp, As); 

*** Chebyshev-2 Filter Order = 4 

>> % Calculation of second-order sections: 
>> (C,B,A] = sdir2cas(b,a) 


C = 0.1585 
B = 1.0000 0 6.0654 
1.0000 0 1.0407 4 


A = 1.0000 1.9521 1.4747 

1.0000 0.3719 0.6784 
>> % Calculation of Frequency Response: 
>> [db,mag,pha,w] = freqs_m(b,a,0.5*pi) ; 
>> % Calculation of Impulse response: 
>> [ha,x,t] = impulse(b,a); 


ee a À 


The specifications are satisfied by a 4th-order Chebyshev-II filter whose system 
function is 


0.1585 (s? + 6.0654) (s? + 1.0407) 


Ha (8) = 

















(s? + 1.95215 + 1.4747) (s? + 0.3719s + 0.6784) 
The filter plots are shown in Figure 8.7. a 
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FIGURE 8.7 Chebyshev-II analog filter in Example 8.7 
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These filters exhibit equiripple behavior in the passband as well as in 
the stopband. They are similar in magnitude response characteristics to 
the FIR equiripple filters. Therefore elliptic filters are optimum filters 
in that they achieve the minimum order N for the given specifications 
(or alternately, achieve the sharpest transition band for the given order. 
N). These filters, for obvious reasons, are very difficult to analyze and, 
therefore, to design. It is not possible to design them using simple tools, 
and often programs or tables are needed to design them. 
'The magnitude-squared response of elliptic filters is given by 


1 
Q 

1+ e Uh (s) 
where N is the order, e is the passband ripple (which is related to Rọ), 
and Uy (-) is the Nth order Jacobian elliptic function. The analysis of 
this function, even on a superficial level, is beyond the scope of this book. 
Note the similarity between the above response (8.22) and that of the 
Chebyshev filters given by (8.13). Typical responses for odd and even N 
are shown below. : 





|. Go) = 2) 


|H, UON 





COMPUTATION Even though the analysis of (8.22) is difficult, the order calculation for- 
OF FILTER mula is very compact and is available in many textbooks [16, 19, 20]. It 
ORDER N is given by 
Fe K(k)K (vi = K) d 
~ K(k) K (V1 — F?) i 
where 
2. € 
ob gucci. 
S 01 ARH 
NES a a 7: 
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and 


ko- [" —* 
r)- FORTC GTC EE 
o  vl-zc?sin?0 


is the complete elliptic integral of the first kind. MATLAB provides the 
function ellipke to numerically compute the above integral, which we 
will use to compute N and to design elliptic filters. 


MATLAB provides a function called [z,p,k]-ellipap(N,Rp,As) to de- 
sign a normalized elliptic analog prototype filter of order N, passband 
ripple Rp, and stopband attenuation As, and that returns zeros in z array, 
poles in p array, and the gain value k. We need an unnormalized elliptic 
filter with arbitrary Q.. This is achieved by scaling the arrays p and z of 
the normalized filter by €), and the gain k by the ratio of the unnormalized 
to the normalized rational functions evaluated at s — 0. In the following 
function, called U-elipap(N,Rp,As,Omegac), we design an unnormalized 
elliptic analog prototype filter that returns H, (s) in the direct form. 


function [b,a] = u_elipap(N,Rp,As,Omegac) ; 

% Unnormalized Elliptic Analog Lowpass Filter Prototype 
qu—— ————rs— 
% [b,a] = u elipap(N,Rp,As,Omegac) ; 


4 b = numerator polynomial coefficients 

; a * denominator polynomial coefficients 
X N = Order of the Elliptic Filter 

4 Rp = Passband Ripple in dB; Rp > 0 

4 As = Stopband Attenuation in dB; As > 0 


% Omegac = Cutoff frequency in radians/sec 
* 
[z,p,k] = ellipap(N,Rp,As); 
a = real(poly(p)); 
aNn = a(N*1); 
p = p*Onegac; 
a = real(poly(p)); 
aNu = a(N*1); 
b = real(poly(z)); 
M = length(b); 
bNn = b(M); 
= z*Ümegac; 
b = real(poly(z)); 
bNu = b(M); 
k = k*(aNu*bNn) /(aNn*bNu) ; 
k; 
k*b; 
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Using the U_elipap function, we provide a function called afd_elip 
to design an analog elliptic lowpass filter, given its specifications. This 
is shown below and uses the filter order computation formula given in 
(8.23). 


function [b,a] = afd_elip(Wp,Ws,Rp,As); 
% Analog Lowpass Filter Design: Elliptic 


X [b,a] = afd_elip(Wp,Ws,Rp,As) ; 
% b= Numerator coefficients of Ha(s) 


% a= Denominator coefficients of Ha(s) 
% Wp = Passband edge frequency in rad/sec; Wp > 0 
% Ws = Stopband edge frequency in rad/sec; Ws > Wp > 0 
% Rp = Passband ripple in *dB; (Rp » 0) 
% As = Stopband attenuation in +dB; (As > 0) 
* 
if Wp <= 0 
error(’Passband edge must be larger than 0’) 
end 
if Ws <= Wp 
error(’Stopband edge must be larger than Passband edge’) 
end 


if (Rp <= 0) | (As < 0) 
error(’PB ripple and/or SB attenuation ust be larger than 0’) 
end 


ep = sqrt(107 (Rp/10)-2); 

A = 10^(4s/20); 

OmegaC = Wp; 

k = Wp/Ws; 

k1 = ep/sqrt(A*A-1); 

capk = ellipke([k.^2 1-k.^2]); 4 Version 4.0 code 

capki = ellipke([(ki .72) 1-(k1 .°2)]); % Version 4.0 code 
N = ceil(capk(1)*capki(2)/(capk(2)*capk1(1))); 
fprintf(’\n*** Elliptic Filter Order = 42.0f \n’,N) 
[b,a]=u_elipap(N,Rp, As, Omega) ; 


D EXAMPLE 88 Design an analog elliptic lowpass filter to satisfy the following specifications of 


Example 8.5: 
Qp = 0.27, R,-1dB 
NQ. =0.37, As =16db 


MATLAB Script —__$_$_$_$_?_——_ m 
>> Wp = 0.2»pi; Ws = 0.3*pi; Rp = 1; As = 16; 

>> Ripple = 10 ^ (-Rp/20); Attn = 10 7 (-4s/20) ; 

>> % Analog filter design: 

>> [b,a] = afd elip(Wp,Ws,Rp,As) ; 
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*** Elliptic Filter Order = 3 
>> % Calculation of second-order sections: 
>> [C,B,A] = sdir2cas(b,a) 
C = 0.2740 
B = 1.0000 0 0.6641 
A = 1.0000 0.1696 0.4102 
0 1.0000 0.4435 
>> % Calculation of Frequency Response: 
>> [db,mag,pha,w] = freqs m(b,a,0.5*pi); 
>> % Calculation of Impulse response: 
>> [ha,x,t] = impulse(b,a); 





The specifications are satisfied by a 3rd-order elliptic filter whose system func- 
tion is 


H.(s)- 0.274 (s? + 0.6641) 
a V5 = (62 + 0.16965 + 0.4102) (s + 0.4435) 


The filter plots are shown in Figure 8.8. [m] 
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FIGURE 8.8 Elliptic analog lowpass filter in Example 8.8 
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Elliptic filters provide optimal performance in the magnitude-squared re- 
sponse but have highly nonlinear phase response in the passband (which is 
undesirable in many applications). Even though we decided not to worry 
about phase response in our designs, phase is still an important issue in the 
overall system. At the other end of the performance scale are the Butter- 
worth filters, which have maximally flat magnitude response and require a 
higher-order N (more poles) to achieve the same stopband specification. 
However, they exhibit a fairly linear phase response in their passband. 
The Chebyshev filters have phase characteristics that lie somewhere in 
between. Therefore in practical applications we do consider Butterworth 
as well as Chebyshev filters, in addition to elliptic filters. The choice de- 
pends on both the filter order (which influences processing speed and 
implementation complexity) and the phase characteristics (which control 
the distortion). 


ANALOG-TO-DIGITAL FILTER TRANSFORMATIONS 
—— 


IMPULSE 
INVARIANCE 
TRANSFOR- 
MATION 


After discussing different approaches to the design of analog filters, we are 
now ready to transform them into digital filters. These transformations 
are complex-valued mappings that are extensively studied in the litera- 
ture. These transformations are derived by preserving different aspects 
of analog and digital filters. If we want to preserve the shape of the im- 
pulse response from analog to digital filter, then we obtain a technique 
called impulse invariance transformation. If we want to convert a dif- 
ferential equation representation into a corresponding difference equation 
representation, then we obtain a finite difference approrimation technique. 
Numerous other techniques are also possible. One technique, called step 
invariance, preserves the shape of the step response; this is explored in 
Problem 9. The most popular technique used in practice is called a Bi- 
linear transformation, which preserves the system function representation 
from analog to digital domain. In this section we will study in detail im- 
pulse invariance and bilinear transformations, both of which can be easily 
implemented in MATLAB. 


In this design method we want the digital filter impulse response to look 
“gimilar” to that of a frequency-selective analog filter. Hence we sample 
h(t) at some sampling interval T to obtain h(n); that is, 


h(n) = h,(nT) 


The parameter T' is chosen so that the shape of h(t) is “captured” by 
the samples. Since this is a sampling operation, the analog and digital 
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frequencies are related by 
w — QT or ej? = eT 


Since z = ef” on the unit circle and s = jì on the imaginary axis, we 
have the following transformation from the s-plane to the z-plane: 


z= (8.24) 


The system functions H(z) and H,(s) are related through the frequency- 
domain aliasing formula (3.27): 


H(z) = E Y H, (: - IR) 


k=- 


The complex plane transformation under the mapping (8.24) is shown in 
Figure 8.9, from which we have the following observations: 


1. Using c = Re(s), we note that 


c «0 maps into |z| « 1 (inside of the UC) 
c —0 maps onto |z| = 1 (on the UC) 
c »0 maps into |z| > 1 (outside of the UC) 
2. All semi-infinite strips (shown above) of width 27/T map into 
|z| < 1. Thus this mapping is not unique but a many-to-one mapping. 
3. Since the entire left half of the s-plane maps into the unit circle, a 


causal and stable analog filter maps into a causal and stable digital filter. 
4. If H,(jQ) = Ha(jw/T) = 0 for |Q| > 7/T, then 


H) = z.H,Ge/T), l| Sn 


ja 
; Imt) 


oœ  Many-o-one 
transformation 


es — z 





s-plane z-plane 


FIGURE 8.9 Complez-plane mapping in impulse invariance transformation 
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and there will be no aliasing. However, no analog filter of finite order can 
be exactly band-limited. Therefore some aliasing error will occur in this 
design procedure, and hence the sampling interval T plays a minor role 
in this design method. 


Given the digital lowpass filter specifications up; ws, Rp, and A,, we want 
to determine H (z) by first designing an equivalent analog filter and then 
mapping it into the desired digital filter. The steps required for this pro- 
cedure are 


1. Choose T and determine the analog frequencies 


Wp Ws 
= d =— 
fiy T, an Qs T 

2. Design an analog filter Ha (s) using the specifications Np, Na, Rp, 
and A,. This can be done using any one of the three (Butterworth, Cheby- 
shev, or elliptic) prototypes of the previous section. 

3. Using partial fraction expansion, expand Ha (s) into 





4. Now transform analog poles {px} into digital poles {erT} to ob- 
tain the digital filter: 


N 
Rk 
OD er d 
k=1 
Transform 
= s+i 
Ha (s) = s?+58+6 


into a digital filter H (z) using the impulse invariance technique in which T = 
0.1. 


We first expand Ha (s) using partial fraction expansion: 


813-1 2 1 
H.()- o i6 s48 3+2 








The poles are at pı = —3 and pz = —2. Then from (8.25) and using T = 0.1, 
we obtain 
2 1 1 — 0.896627! 


H (2) = 7— jaar iez 1-155952-!- 0.60652? 
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O EXAMPLE 8.10 


Solution 


BUE Lc 


It is easy to develop a MATLAB function to implement the impulse invari- 
ance mapping. Given a rational function description of H, (s), we can use the 
residue function to obtain its pole-zero description. Then each analog pole is 
mapped into a digital pole using (8.24). Finally, the residuez function can be 
used to convert H (z) into rational function form. This procedure is given in 
the function imp.invr. 


function [b,a] = imp_invr(c,d,T) 

% Impulse Invariance Transformation from Analog to Digital Filter 
[b,a] = imp invr(c,d,T) 

- Numerator polynomial in z^(-1) of the digital filter 

= Denominator polynomial in z^(-1) of the digital filter 

= Numerator polynomial in s of the analog filter 

= Denominator polynomial in s of the analog filter 

= Sampling (transformation) parameter 


ze 


* 
* 
* 
% 
% 
% 


x 


[R,p,k] = residue(c,d); 

p = exp(p*D; 

[b,a] = residuez(R,p,k); 

b = real(b’); a = real(a’); 


A similar function called impinvar is available in the new Student Edition of 
MATLAB. n 


We demonstrate the use of the imp-invr function on the system function from 
Example 8.9. 


MATLAB Script ——___— LL ——————————— 
>> c = [1,1]; d = [1,5,6]; T = 0.1; 

>> [b,a] = imp invr(c,d,T) 

b= 1.0000  -0.8966 

a= 1.0000 -1.5595 0.6065 


Laaa a e aaaaaaaaaaaaaaaaaaaaasasasasasasaasauasasasasasasasauauasstsasasaststltltuttlultlulult$l$la 


The digital filter is 


1 — 0.896627! 


H(z) = 121.55952 1 + 0.60657? 


as expected. In Figure 8.10 we show the impulse responses and the magnitude 
responses (plotted up to the sampling frequency 1 /T) of the analog and the 
resulting digital filter. Clearly, the aliasing in the frequency domain is evident. 

a 


In the next several examples we illustrate the impulse invariance de- 
sign procedure on all three prototypes. 


a 
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Analog fita 
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4 5 
frequency in Hz 
FIGURE 8.10 Impulse and frequency response plots in Example 8.10 


D  EXAMPLE&1 Design a lowpass digital filter using a Butterworth prototype to satisfy 


wp = 0.27, Rp=1dB 
ws = 0.37, As = 15 dB 


The design procedure is described in the following MATLAB script: 


>> % Digital Filter Specifications: 

>> wp = 0.2*pi; % digital Passband freq in Hz 
>> ws = 0.3*pi; % digital Stopband freq in Hz 
>> Rp = 1; : X Passband ripple in dB 

>> As = 15; % Stopband attenuation in dB 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 
»T-z-1; X Set T=1 

>> OmegaP = wp / T; % Prototype Passband freq 

>> OmegaS = ws / T; % Prototype Stopband freq 


>> % Analog Butterworth Prototype Filter Calculation: 
>> [cs,ds] = afd_butt (OmegaP ,OmegaS ,Rp, As) ; 
+++ Butterworth Filter Order = 6 


LM. ee SS SS So 
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>> % Impulse Invariance transformation: 
>> [b,a] = imp_invr(cs,ds,T); 
>> (C,B,A] = dir2par(b,a) 
c= 0D 
B= 1.8557 -0.6304 
-2.1428 1.1454 
0.2871 -0.4466 
A = 1.0000 -0.9973 0.2570 
1.0000 -1.0691 0.3699 
1.0000 -1.2972 0.6949 


The desired filter is a 6th-order Butterworth filter whose system function H (z) 
is given in the parallel form 


1.8587 — 0.63042! —2.1428 + 1.14542! 





H ee oom 
(2) = 1— 59973271 4-0.2577-3 ` 1— 1.0691z-! + 0.369927 
, 90280 - 0.44637! 
1 — 1.2972z-! + 0.644927? 
The frequency response plots are given in Figure 8.11. a 
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FIGURE 8.11 Digital Butterworth lowpass filter using impulse invariance design 
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D  EXAMPLE&12 Design a lowpass digital filter using a Chebyshev-I prototype to satisfy 
wp = 0.27, Rp = 1 dB 
ws = 0.37, A. = 15 dB 


Solution The design procedure is described in the following MATLAB script: 
>> % Digital Filter Specifications: 
>> wp = 0.2*pi; % digital Passband freq in Hz 
>> ws = 0.3*pi; % digital Stopband freq in Hz 
>> Rp = 1; % Passband ripple in dB 
>> As = 15; % Stopband attenuation in dB 


>> X Analog Prototype Specifications: Inverse mapping for frequencies 
»T-1; % Set T=1 

>> OmegaP = wp / T; % Prototype Passband freq 

>> OmegaS = ws / T; % Prototype Stopband freq 


>> % Analog Chebyshev-1 Prototype Filter Calculation: 
>> [cs,ds] = afd_chbi(OmegaP,OmegaS ,Rp, As) ; 
*** Chebyshev-1 Filter Order = 4 


>> % Impulse Invariance transformation: 
>> [b,a] = imp_invr(cs,ds,T); 
>> ([C,B,A)] = dir2par(b,a) 
c= 0 
B =-0.0833 -0.0246 
0.0833 0.0239 
A = 1.0000 -1.4934 0.8392 
1.0000 -1.5658 0.6549 


The desired filter is a 4th-order Chebyshev-I filter whose system function H (z) 


is 
H()- —0.0833 — 0.02462 ^! 4 —0.0833 + 0.02392! 
= 1-—1.4934z-1--0.83922-?  1-— 1.56582-! + 0.65492? 
The frequency response plots are given in Figure 8.12. o 


O EXAMPLE &13 Design a lowpass digital filter using a Chebyshev-II prototype to satisfy 
up =0.20, Rp =1dB 
wa = 0.37, A,=15dB 


Solution Recall that the Chebyshev-II filter is equiripple in the stopband. It means that 
this analog filter has a response that does not go to zero at high frequencies in 
the stopband. Therefore after impulse invariance transformation, the aliasing 
effect will be significant; this can degrade the passband response. The MATLAB 
script is shown: 


UAn EC MU AL. E EEED UT 
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>> % Digital Filter Specifications: EXAMPLE 8.14 Design a lowpass digital filter using an elliptic prototype to satisfy 


>> wp = 0.2*pi; % digital Passband freq in Hz Wp = 0.27, Ryp=1dB 
>> ws = 0.3*pi; % digital Stopband freq in Hz 
>> Rp = 1; % Passband ripple in dB WD cda em doe 
>> As = 15; i i 
e t X Stopband attenuation in dB Solution The elliptic filter is equiripple in both bands. Hence this situation is similar to 


that of the Chebyshev-II filter, and we should not expect a good digital filter. 


>> % Analog Prototype Specifications: Inverse mapping for frequencies The MATLAB script is shown: 


»T-1; 4 Set T=1 

>> ÜmegaP = wp / T; X Prototype Passband freq >> ¥ Digital Filter Specifications: 

>> ÜmegaS = ws / T; % Prototype Stopband freq >> wp = 0.2*pi; % digital Passband freq in Hz 
>> ws = 0.3*pi; % digital Stopband freq in Hz 

>> % Analog Chebyshev-1 Prototype Filter Calculation: >> Rp = 1; % Passband ripple in dB 

>> [cs,ds] = afd_chb2(OmegaP ,OmegaS Rp, As) ; >> As = 15; % Stopband attenuation in dB 


*** Chebyshev-2 Filter Order = 4 
>> % Analog Prototype Specifications: Inverse mapping for frequencies 


>> % Impulse Invariance transformation: > T=1; % Set T=1 
>> [b,a] = imp_invr(cs,ds,T); >> OmegaP = wp / T; % Prototype Passband freq 
>> [C,B,A] = dir2par(b,a); >> OmegaS = ws / T; % Prototype Stopband freq 
From the frequency response plots in Figure 8.13 we clearly observe the pass- >> % Analog Elliptic Prototype Filter Calculation: 
band as well as stopband degradation. Hence the impulse invariance design >> [cs,ds] = afd_elip(OmegaP , OmegaS ,Rp,As) ; 
technique has failed to produce a desired digital filter. a *** Elliptic Filter Order = 3 
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FIGURE 8.14 Digital elliptic lowpass filter using impulse invariance design 


>> 4 Impulse Invariance transformation: 
>> [b,a] = imp_invr(cs,ds,T); 
>> [C,B,A] = dir2par(b,a); 


From the frequency response plots in Figure 8.14 we clearly observe that once 
again the impulse invariance design technique has failed. a 


The advantages of the impulse invariance mapping are that it is a 
stable design and that the frequencies and w are linearly related. But 
the disadvantage is that we should expect some aliasing of the analog 
frequency response, and in some cases this aliasing is intolerable. Conse- 
quently, this design method is useful only when the analog filter is essen- 
tially band-limited to a lowpass or bandpass filter in which there are no 
oscillations in the stopband. 


This mapping is the best transformation method; it involves a well-known 
function given by 


21-z1! | lcsT/2 


5—mT1yz3  * *ToeT 


(8.26) 


Chapter 8 # HR FILTER DESIGN 








Analog-to-Digital Filter Transformations 


where T is a parameter. Another name for this transformation is the linear 
fractional transformation because when cleared of fractions, we obtain 


T 
yet ys 241=0 


which is linear in each variable if the other is fixed, or bilinear in s and z. 
The complex plane mapping under (8.26) is shown in Figure 8.15, from 
which we have the following observations: 


1. Using s = c + jQ in (8.26), we obtain 


ro (rs Bas) (-moum) o wm 


Hence 




















2. The entire left half-plane maps into the inside of the unit circle. 
Hence this is a stable transformation. 

3. The imaginary axis maps onto the unit circle in a one-to-one fash- 
ion. Hence there is no aliasing in the frequency domain. 


ja Imtz) 


Unit circle 












o One-to-one 
transformation 
1+ (87/2) _ 
1-672 — 


Re{z} 





s-plane z-plane 


FIGURE 8.15 Complez-plane mapping in bilinear transformation 
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Substituting o = 0 in (8.27), we obtain 


= 7_ jar = 
2 


since the magnitude is 1. Solving for w as a function of Q, we obtain 


QT 
w = 2tan7} (&) o Q= zen (2) (8.28) 


This shows that Q is nonlinearly related to (or warped into) w but that 


there is no aliasing. Hence in (8.28) we will say that w is prewarped into 
Q. 


s+1 
s?+58+6 
mation. Choose T = 1. 


Transform Ha(s) = into a digital filter using the bilinear transfor- 


Using (8.26), we obtain 








21-27 1-27 
H = = — LI——— 
(z) Ha (3 1z! ) Ha (24 ee 
T=1 
i207 
E Tiu +1 





Simplifying, 


3-27! —27 045-4017! — 0.0527? 


H = 
iz 20+ 4z-1 13 027-71 


Qo 


MATLAB provides a function called bilinear to implement this map- 
ping. Its invocation is similar to the imp_invr function, but it also takes 
several forms for different input-output quantities. The Student Edition 
manual should be consulted for more details. Its use is shown in the fol- 
lowing example. 


Transform the system function Ha (s) in Example 8.15 using the bilinear 
function. 


MATLAB Script 
>> c = [1,1]; d = [1,5,6]; T = 1; Fs = 1/T; 
>> [b,a] = bilinear(c,d,Fs) 

b = 0.1500 0.1000 -0.0500 

a = 1.0000 0.2000 0.0000 
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The filter is 


0.15 + 0.127! — 0.0527? 
H(z) = 140.27 


as before. o 


Given digital filter specifications wp, ws, Rp, and A,, we want to determine 
H(z). The design steps in this procedure are the following: 


1. Choose a value for T. This is arbitrary, and we may set T = 1. 
2. Prewarp the cutoff frequencies wp and ws; that is, calculate 2, and 
Q, using (8.28): 


p= 2ean(%#), n-im(f) em 


3. Design an analog filter Hz (s) to meet the specifications Ny, Qs, 
Rp, and A,. We have already described how to do this in the previous 
section. 

4. Finally, set 


21-27 
n = H (prre) 
and simplify to obtain H(z) as a rational function in got, 


In the next several examples we demonstrate this design procedure 
on our analog prototype filters. 


O EXAMPLE8.17__ Design the digital Butterworth filter of Example 8.11. The specifications are 


T= 1; Fs = 1/T; 
OmegaP = (2/T)*tan(wp/2) ; 
>> OmegaS = (2/T)*tan(ws/2); 


wp =0.27, Rp =1 dB 
ws = 0.3m, A, = 15 dB 


MATLAB Script M 


% Digital Filter Specifications: 


wp = 0.2*pi; % digital Passband freq in Hz 
ws = 0.3*pi; % digital Stopband freq in Hz 
Rp = 1; % Passband ripple in dB 

As = 15; % Stopband attenuation in dB 
% Analog Prototype Specifications: Inverse mapping for frequencies 


% Set T=1 
% Prewarp Prototype Passband freq 
% Prewarp Prototype Stopband freq 


>> % Analog Butterworth Prototype Filter Calculation: 
>> [cs,ds] = afd_butt (OmegaP ,OmegaS ,Rp, As); 
+*+ Butterworth Filter Order = 6 


mo a ea ee ——————————— UÉN ESQ RECIPERE ERE REESE Cr em 
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>> 4 Bilinear transformation: 

>> [b,a] = bilinear(cs,ds,Fs); 

>> [C,B,A] = dir2cas(b,a) 

C = 5.7969e-004 

B = 1.0000 2.0183 1.0186 
1.0000 1.9814 0.9817 
1.0000 2.0004 1.0000 

A= 1.0000 -0.9459 0.2342 
1.0000 -1.0541 0.3753 
1.0000 -1.3143 0.7149 


L e e M 


The desired filter is once again a 6th-order filter and has 6 zeros. Since the 
6th-order zero of Ha (s) at's = —oo is mapped to z = —1, these zeros should be 
at z = —1. Due to the finite precision of MATLAB these zeros are not exactly at 
z = —1. Hence the system function should be 


Hohe 0.00057969 (1 + 27*)° 
2) = (1 0.945921 + 0.23422?) (1 — 1.054121 + 0.375327?) (1 — 1.314327! + 0.714927?) 


The frequency response plots are given in Figure 8.16. Comparing these plots 
with those in Figure 8.11, we observe that tbese two designs are very similar. 
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FIGURE 8.16 Digital Butterworth lowpass filter using bilinear transformation 
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D EXAMPLE 8.18 Design the digital Chebyshev-I filter of Example 8.12. The specifications are 
wp 0.2, Rp =1dB 
w, =0.37, A,-—15dB 


Solution MATLAB Script. m m 
>> 4 Digital Filter Specifications: 
>> wp = 0.2*pi; % digital Passband freq in Hz 
>> ws = 0.3*pi; % digital Stopband freq in Hz 
>> Rp = 1; % Passband ripple in dB 
>> As = 15; % Stopband attenuation in dB 
>> % Analog Prototype Specifications: Inverse mapping for frequencies 
>> T = 1; Fs = 1/T; % Set T-1 


>> OmegaP = (2/T)*tan(wp/2); % Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2); 4, Prewarp Prototype Stopband freq 
>> % Analog Chebyshev-1 Prototype Filter Calculation: 
>> [cs,ds] = afd_chb1 (OmegaP , OmegaS ,Rp, As); 
*** Chebyshev-1 Filter Order = 4 
>> % Bilinear transformation: 
>> [b,a] = bilinear(cs,ds,Fs) ; 
>> [C,B,A] = dir2cas(b,a) 
C = 0.0018 
B = 1.0000 2.0000 1.0000 
1.0000 2.0000 1.0000 
A= 1.0000  -1.4996 0.8482 
1.0000 -1.5548 0.6493 


RS 


The desired filter is a 4th-order filter and has 4 zeros at z = —1. The system 
function is 


m 0.0018 (1 + z7!)* 
(2) = 021.499621 + 0.84822?) (1 — 1.554827! + 0.649327?) 


The frequency response plots are given in Figure 8.17 which are similar to those 
in Figure 8.12. n 


O EXAMPLE819 Design the digital Chebyshev-I filter of Example 8.13. The specifications are 
wp =0.27, Rp =1 dB 
ws = 0.37, A, = 15 dB 

Solution MATLAB Script. —— ————————————————————— 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; 4 digital Passband freq in Hz 


>> ws = 0.3*pi; % digital Stopband freq in Bz 
>> Rp = 1; % Passband ripple in dB 
>> As = 15; % Stopband attenuation in dB 
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-> 


FIGURE 8.17 Digital Chebyshev-I lowpass filter using bilinear transformation 


>> % Analog Prototype Specifications: Inverse mapping for frequencies 
>> T = 1; Fs = 1/T; % Set T=1 
>> OmegaP = (2/T)*tan(wp/2); X Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2); % Prewarp Prototype Stopband freq 
>> % Analog Chebyshev-2 Prototype Filter Calculation: 
>> [cs,ds] = afd_chb2(OmegaP ,OmegaS ,Rp, As) ; 
*** Chebyshev-2 Filter Order = 4 
>> % Bilinear transformation: 
>> [b,a] = bilinear(cs,ds,Fs) ; 
>> [C,B,A] = dir2cas(b,a) 
C = 0.1797 
B * 1.0000 0.5574 1.0000 
1.0000 -1.0671 1.0000 
A = 1.0000 -0.4183 0.1503 
1.0000 -1.1325 0.7183 





The desired filter is again a 4th-order filter with system function 


(2) = 0.1797 (1 + 0.55742? + 27) (1— 1.067127? + 277) 
(1 — 0.418327! + 0.150327?) (1 — 1.13252-1 + 0.71832-?) 
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FIGURE 8.18 Digital Chebyshev-II lowpass filter using bilinear transformation 


The frequency response plots are given in Figure 8.18. Note that the bilinear 
transformation has properly designed the Chebyshev-II digital filter. n 


O EXAMPLE 8&20 Design the digital elliptic filter of Example 8.14. The specifications are 


wp = 0.2, Rp =1 dB 
w,—0.3m, As =15 dB 


MATLAB Script. ————————————————————————— 
>> % Digital Filter Specifications: 
>> wp = 0.2*pi; 
>> ws = 0.3*pi; 


% digital Passband freq in Hz 
X digital Stopband freq in Hz 


>> Rp = 1; X Passband ripple in dB 

>> As = 15; 4 Stopband attenuation in dB 
>> % Analog Prototype Specifications: Inverse mapping for frequencies 
>> T = 1; Fs = 1/T; % Set T=1 


>> OmegaP = (2/T)*tan(wp/2); X Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2); % Prewarp Prototype Stopband freq 
>> % Analog Elliptic Prototype Filter Calculation: 

>> [cs,ds) = afd_elip(OmegaP ,OmegaS ,Rp, As) ; 

«ae Elliptic Filter Order = 3 

>> % Bilinear transformation: 
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>> [b,a] = bilinear(cs,ds,Fs); 
>> [C,B,A) = dir2cas(b,a) 


C = 0.1214 

B = 1.0000 -1.4211 1.0000 
1.0000 1.0000 0 

A = 1.0000 -1.4928 0.8612 
1.0000 -0.6183 0 





The desired filter is a 3rd-order filter with system function 


0.1214 (1 — 1.421127} + z?) (1+ z”) 


H (z) = ————————————————— 
(2) (1 — 1.49282-! + 0.86122-?) (1 — 0.6183z—!) 


The frequency response plots are given in Figure 8.19. Note that the bilinear 
transformation has again properly designed the elliptic digital filter. o 


The advantages of this mapping are that (a) it is a stable design, 
(b) there is no aliasing, and (c) there is no restriction on the type of filter 
that can be transformed. Therefore this method is used exclusively in 
computer programs including MATLAB as we shall see next. 
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FIGURE 8.19 Digital elliptic lowpass filter using bilinear transformation 
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LOWPASS FILTER DESIGN USING MATLAB 
————————— mp — 


In this section we will demonstrate the use of MATLAB’s filter design 
routines to design digital lowpass filters. These functions use the bilinear 
transformation because of its desirable advantages as discussed in the 
previous section. These functions are as follows: 


1. [b,a]-butter(N,wn) 

This function designs an Nth-order lowpass digital Butterworth filter 
and returns the filter coefficients in length N +1 vectors b and a. The filter 
order is given by (8.10), and the cutoff frequency wn is determined by the 
prewarping formula (8.29). However, in MATLAB all digital frequencies are 
given in units of v. Hence wn is computed by using the following relation: 


Wn = 2 tan"! 5) 
T 2 


The use of this function is given in Example 8.21. 

2. [b,a]=cheby1(N,Rp, wn) 

This function designs an Nth-order lowpass digital Chebyshev-I filter 
with Rp decibels of ripple in the passband. It returns the filter coefficients 
in length N + 1 vectors b and a. The filter order is given by (8.20), and 
the cutoff frequency wn is the digital passband frequency in units of 7; 
that is, 


Wy = Wp/T 


The use of this function is given in Example 8.22. 

3. [b,a]=cheby2(N,As,wn) 

This function designs an Nth-order lowpass digital Chebyshev-II filter 
with the stopband attenuation As decibels. It returns the filter coefficients 
in length N +1 vectors b and a. The filter order is given by (8.20), and 
the cutoff frequency wn is the digital stopband frequency in units of r; 
that is, 


Wn = WaT 


The use of this function is given in Example 8.23. 

4. [b,a]=ellip(N,Rp,As,wn) 

This function designs an Nth-order lowpass digital elliptic filter with 
the passband ripple of Rp decibels and a stopband attenuation of As deci- 
bels. It returns the filter coefficients in length N + 1 vectors b and a. The 
filter order is given by (8.23), and the cutoff frequency wn is the digital 
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O EXAMPLE 8.21 


>> 
>> 
>> 
>> 
>> 


>> 
>> 
>> 
>> 


passband frequency in units of 7; that is, 
Wn = Wp/T 
The use of this function is given in Example 8.24. 


All these above functions can also be used to design other frequency- 
selective filters, such as highpass and bandpass. We will discuss their 
additional capabilities in Section 8.5. 

There is also another set of filter functions, namely the buttord, 
chebiord, cheb2ord, and ellipord functions, which can provide filter 
order N and filter cutoff frequency wpn, given the specifications. These 
functions are available in the Signal Processing toolbox but not in the 
Student Edition, and hence in the examples to follow we will determine 
these parameters using the formulas given earlier. We will discuss the 
filter-order functions in the next section. 

In the following examples we will redesign the same lowpass filters 
of previous examples and compare their results. The specifications of the 
lowpass digital filter are 


Wp = 0.27, Rp =1dB 
ws = 0.37, A, = 15 dB 


Digital Butterworth lowpass filter design: 


% Digital Filter Specifications: 

wp = 0.2*pi; “digital Passband freq in Hz 

ws = 0.3*pi; “digital Stopband freq in Hz 

Rp = 1; XPassband ripple in dB 

As = 15; XStopband attenuation in dB 

% Analog Prototype Specifications: 

T=1; XSet T=1 

OmegaP = (2/T)*tan(wp/2) ; XPrewarp Prototype Passband freq 
OmegaS = (2/T)*tan(ws/2); XPrewarp Prototype Stopband freq 
% Analog Prototype Order Calculation: 


N =ceil((10g10((10* (Rp/10)-1)/ (107 (48/10) -1))) /(2*10g10(OmegaP/OmegaS) )) ; 


fprintf(’\nt#* Butterworth Filter Order = 42.0f \n’,N) 

Butterworth Filter Order = 6 

OmegaC = OmegaP/((10^(Rp/10)-1)^(1/(2*N))); ZAnalog BW prototype cutoff 
wn = 2*atan((OmegaC*T) /2); “Digital BW cutoff freq 

% Digital Butterworth Filter Design: 

wn = wi/pi; “Digital Butter cutoff in pi units 
[b, a] sbutter(N,wn); 


(b0,B,A] = dir2cas(b,a) 
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.7969e-004 
.0000 2.0297 1.0300 


5 

1 

1.0000 1.9997 1.0000 
1.0000 1.9706 0.9709 
1.0000 -0.9459 0.2342 
1.0000 -1.0541 0.3753 
1.0000 -1.3143 0.7149 


The system function is 


0.00057969 (1 + 27!) 
i Se 
H (2) = (709459771 + 0.234222) (1 — 1.054127 + 0.375327?) (1 — 1.314327! + 0.71492~*) 


which is the same as in Example 8.17. The frequency-domain plots were shown 
in Figure 8.16. o 


D EXAMPLE8.22 Digital Chebyshev-I lowpass filter design: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; «digital Passband freq in Hz 
>> ws = 0.3*pi; Ydigital Stopband freq in Hz 
>> Rp = 1; %Passband ripple in dB 

>> As = 15; XStopband attenuation in dB 


>> % Analog Prototype Specifications: 


»T-1; %Set T=1 

>> OmegaP = (2/T)*tan(wp/2); XPréwarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(wus/2); XPrewarp Prototype Stopband freq 
>> % Analog Prototype Order Calculation: à 

>> ep = sqrt(10^ (Rp/10)-1); %Passband Ripple Factor 

>> A = 107(4s/20); XStopband Attenuation Factor 

>> OmegaC = OmegaP; XAnalog Prototype Cutoff freq 

>> OmegaR = OmegaS/OmegaP; YAnalog Prototype Transition Ratio 
>> g = sqrt(A*A-1)/ep; "Analog Prototype Intermediate cal. 


>> N= ceil (1og10(gtsqrt (g*g-1))/1ogi0 (OmegaR+sqrt (OmegaR+OmegaR-1))) ; 
>> fprintf(’\n*++ Chebyshev-1 Filter Order = %2.0f \n’ ,N) 
*** Chebyshev-1 Filter Order = 4 


>> % Digital Chebyshev-I Filter Design: 
>> wn = wp/pi; XDigital Passband freq in pi units 
>> [b,a]=cheby1(N,Rp,wn) ; 
>> [b0,B,A] = dir2cas(b,a) 
bo = 0.0018 
B = 1.0000 2.0000 1.0000 
1.0000 2.0000 1.0000 
A= 1.0000 -1.4996 0.8482 
1.0000 | -1.5548 0.6493 
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The system function is 


0.0018 (1 + 271)* 
— 1.49962-! + 0.84822-2) (1 — 1.55482-! + 0.64932?) 





H(z)= a 


which is the same as in Example 8.18. The frequency-domain plots were shown 
in Figure 8.17. o 


O EXAMPLE 8.23 Digital Chebyshev-II lowpass filter design: 


>> 
>> 
>> 
>> 
>> 


>> 
>> 
>> 
>> 


>> 
>> 
>> 


% Digital Filter Specifications: 


wp = 0.2*pi; %digital Passband freq in Hz 
ws = 0.3*pi; Zdigital Stopband freq in Hz 
Rp = 1; XPassband ripple in dB 

As = 15; KStopband attenuation in dB 

% Analog Prototype Specifications: 


T= 1; Set T=1 
OmegaP = (2/T)*tan(wp/2); %Prewarp Prototype Passband freq 
OmegaS = (2/T)*tan(ws/2) ; XPrewarp Prototype Stopband freq 


% Analog Prototype Order Calculation: 


ep = sqrt (107 (Rp/10)-1) ; %Passband Ripple Factor 

A = 10°(As/20); XStopband Attenuation Factor 
OmegaC = OmegaP; "Analog Prototype Cutoff freq 
OmegaR = OmegaS/OmegaP; XAnalog Prototype Transition Ratio 


g = sqrt(A*A-1)/ep; "Analog Prototype Intermediate cal. 
N = ceil(logi0(g+sqrt (g*g-1)) /1og10(OmegaRtsqrt (OnegaR*ÜnegaR-1))) ; 
fprintf CNn*** Chebyshev-2 Filter Order = 42.0f \n’,N) 


*** Chebyshev-2 Filter Order = 4 


>> 


% Digital Chebyshev-II Filter Design: 


>> wn = ws/pi; Digital Stopband freq in pi units 


>> 
>> 


{b, a] =cheby2(N,AS,wn) ;. 
[b0,B,A] = dir2cas(b,a) 


bO = 0.1797 
B = 1.0000 0.5574 1.0000 


A= 


1.0000 ~1.0671 1.0000 
1.0000 -0.4183 0.1503 
1.0000 -1.1325 0.7183 


The system function is 


H()- 0.1797 (1 + 0.557427} + 277) (1— 1.067127! + 277) 
7/7 (1— 0418327! + 0.150322) (1 — 1.13257! + 0.71832?) 


which is the same as in Example 8.19. The frequency-domain plots were shown 
in Figure 8.18. n 
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O EXAMPLE&24 Digital elliptic lowpass filter design: 


>> % Digital Filter Specifications: 


>> wp = 0.2*pi; Ydigital Passband freq in Hz 
>> ws = 0.3*pi; "digital Stopband freq in Hz 
>> Rp = 1; ¥%Passband ripple in dB 

>> As = 15; ¥Stopband attenuation in dB 


>> % Analog Prototype Specifications: 

>> T=1; %Set T=1 : 

>> OmegaP = (2/T)*tan(wp/2); ¥Prewarp Prototype Passband freq 
>> OmegaS = (2/T)*tan(ws/2); %Prevarp Prototype Stopband freq 


>> % Analog Elliptic Filter order calculations: 

>> ep = sqrt (10° (Rp/10)-1); ¥%Passband Ripple Factor 

>> A = 107(As/20); Ystopband Attenuation Factor 

>> OmegaC = OmegaP; YAnalog Prototype Cutoff freq i 
>> k = OmegaP/OmegaS; fAnalog Prototype Transition Ratio; 
>> ki = ep/sqrt(A*A-1); «Analog Prototype Intermediate cal. 
>> capk = ellipke([k.^2 1-k.72); 

>> capki = ellipke([(k1 .~2) i-(k1 .72)D; 

>> N= ceil(capk(1)*capki(2)/(capk(2) *capk1(1))) ; 

>> fprintf (Wee Elliptic Filter Order = %42.0£ \n’,N) 

xe Elliptic Filter Order = 3 


>> % Digital Elliptic Filter Design: nod 
>> wn = wp/pi; {Digital Passband freq in pi units 
>> [b,a]=ellip(N,Rp,As,wn) ; 

>> [b0,B,A] = dir2cas(b,a) 


b0 = 0.1214 

B = 1.0000 -1.4211 1.0000 
1.0000 1.0000 0 

A - 1.0000 -1.4928 0.8612 
1.0000 -0.6183 0 


The system function is 
0.1214 (1 - 142112 + 27?) (1 27) 
PEN easi elles oL EIE 7. PR ERE 
Hos (1 — 1.492827! + 0.86122-?) (1 — 0.618321) 


which is the same as in Example 8.20. The frequency-domain plots were shown 
in Figure 8.19. D 


COMPARISON In our examples we designed the same digital filter using four different 
OF THREE prototype analog filters. Let us compare their performance. The specifi- 


cations were wp = 0.27, Rp = 1 dB, w, = 0.37, and A, = 15 dB. This 
comparison in terms of order N and the minimum stopband attenuations 
is shown in Table 8.1. 
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TABLE 8.1 Comparison of three filters 








Prototype Order N Stopband Att. 
Butterworth 6 15 
Chebyshev-I 4 25 
Elliptic 3 27 





Clearly, the elliptic prototype gives the best design. However, if we 
compare their phase responses, then the elliptic design has the most non- 
linear phase response in the passband. 


FREQUENCY-BAND TRANSFORMATIONS 
m 


In the preceding two sections we designed digital lowpass filters from 
their corresponding analog filters. Certainly, we would like to design other 
types of frequency-selective filters, such as highpass, bandpass, and band- 
stop. This is accomplished by transforming the frequency axis (or band) 
of a lowpass filter so that it behaves as another frequency-selective fil- 
ter. These transformations on the complex variable z are very similar 
to bilinear transformations, and the design equations are algebraic. The 
procedure to design a general frequency-selective filter is to first design 
a digital prototype (of fixed bandwidth, say unit bandwidth) lowpass fil- 
ter and then to apply these algebraic transformations. In this section 
we will describe the basic philosophy behind these mappings and illus- 
trate their mechanism through examples. MATLAB provides functions that 
incorporate frequency-band transforination in the s-plane. We will first 
demonstrate the use of the z-plane mapping and then illustrate the use of 
MATLAB functions. Typical specifications for most commonly used types 
of frequency-selective digital filters are shown in Figure 8.20. 

Let Hzp(Z) be the given prototype lowpass digital filter, and let H(z) 
be the desired frequency-selective digital filter. Note that we are using 
two different frequency variables, Z and z, with Hr p and H, respectively. 
Define a mapping of the form 


Z^ = G(e") 
such that 
A(z) = Hpp(Z)|z-s 64-1) 
To do this, we simply replace Z^! everywhere in Hyp by the function 


G(z^!). Given that Hr p(Z) is a stable and causal filter, we also want 
H(z) to be stable and causal. This imposes the following requirements: 


—_—_ ee ——————————— 
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FIGURE 8.20 Specifications of frequency-selective füters 


1. G(-) must be a rational function in z7? so that H(z) is imple- 


ntable. - 
d 2. The unit circle of the Z-plane must map onto the unit circle of the 


-plane. : 
2 3. For stable filters, the inside of the unit circle of the Z-plane must 


also map onto the inside of the unit circle of the z-plane. 

Let w' and w be the frequency variables of Z and z, respectively—that 
is, Z = ej” and z = ef” on their respective unit circles. Then requirement 
2 above implies that 

|z- = 16675] = |e) 21 


and ; 
e? = G(T) ee ^? 


Or 
—w = £G(e?") 
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The general form of the function G(-) that satisfi i 
: es the above requirem 
is a rational function of the all-pass type given by " E 


where {a;| < 1 for stability and to satisfy requirement 3. 

Now by choosing an appropriate order n and the coefficients (o), we 
can obtain a variety of mappings. The most widely used transformations 
are given in Table 8.2. We will now illustrate the use of this table for 
designing a highpass digital filter. 


TABLE 8.2 Frequency transformation for digital filt 
has cutoff frequency w) igital filters (prototype lowpass filter 








Transformation Transformation Parameters 
jb cu z-a 
Io We = cutoff frequency of new filter 


a Sin (uc — we) /2] 
sin [(w} + we) /2] 


zi—- zi+ta 
Tyas We = cutoff frequency of new filter 
a = S [we + we) /2] 
cos [(w — we) /2] 
z7! — z? -az +02 


or ee ene | we = lower cutoff frequency 


Wy = upper cutoff frequency 
01 = —28K/(K +1) 
02 = (K — 1)/(K +1) 
g = Se [os n) /2 
cos [(wu — we) /2] 
Wu — Ut wL 


2 tan -5 





K = cot 


-1 „Zarita 
a3 oaz i1 we = lower cutoff frequency 

Wu = upper cutoff frequency 
o1 = —26/(K +1) 
a = (K -1)/(K +1) 
poe [(wu + we) /2] 

cos [(wu — we) /2] 
Wu — Ut wh 


2 tan -> 





K =tan 
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O EXAMPLE 8.25 


In Example 8.22 we designed a Chebyshev-I lowpass filter with specifications 
wp =0.2", Rp=1 dB 
w, =0.37, A, = 15 dB 

and determined its system function 


Hrp(Z) = 0.001836(1 + Z-1)* 
LP(Z) = 1 —1.49962-1 x 0.84822-77)(1 — 1.55482- + 0.649327) 


Design a highpass filter with the above tolerances but with passband beginning 
at wp = 0.67. 


We want to transform the given lowpass filter into a highpass filter such that 
the cutoff frequency wp = 0.27 is mapped onto the cutoff frequency wp = 0.67. 
From Table 8.2 


... eos[(0.2v + 0.67)/2 _ 
= eas tenia ^ 0.38197 (8.30) 


Hence 


Hyp(2) = H(Z)l,.. .-osuor. 
1—0.38197z^ 
Á 0.024261 — 27") 
= (14-0.5661z-! + 0.76572-2)(1 + 1.0416z-! + 0.401927?) 
which is the desired filter. The frequency response plots of the lowpass filter 
and the new highpass filter are shown in Figure 8.21. a 


From the above example it is obvious that to obtain the rational 
function of a new digital filter from the prototype lowpass digital filter, 
we should be able to implement rational function substitutions from Ta- 
ble 8.2. This appears to be a difficult task, but since these are algebraic 
functions, we can use the conv function repetitively for this purpose. The 
following zmapping function illustrates this approach. 


function [bz,az] = zmapping(bZ,aZ,Nz,Dz) 

% Frequency band Transformation from Z-domain to z-domain 
Y, ------------ eem em ---TmMT—Tm0MMTMMMMMÁMÁMÁ 
% [bz,az] = zmapping(bZ,aZ,Nz,Dz) 


% performs: 

% b(z (2I 

* ---- = ----| N(z) 
* a(z) a(2lez = ---- 
* D(z) 


p 
bzord = (ength(bZ)-1)+ length (Nz) -1) ; 
azord = (length(aZ)-1)*(length(D2)-1); 


bz = zeros(1,bzord+1) ; 
for k = O:bzord 


o COE AM DEED NE NE CROSSES C7 
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FIGURE 8.21 Magnitude response plots for Example 8.25 


pin - (11; 
for 1 = O:k-1 
pln = conv(pln,Nz); 
end 
pid = (1]; 
for 1 = O:bzord-k-1 
pld = conv(pld,Dz); 
end 
bz = bz*bZ(k*1)*conv(pln,pld); 
end 


az * zeros(i,azord*i); 
for k = O:azord 
pln = [1]; 
for 1 = 0:k-1 
pln = conv(pln,Nz); 
end 
pid = [1]; 
for 1 = O:azord-k-1 
pid = conv(pld,D2); 
end 
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az = aztaZ(k+1)*conv(pin,pld) ; 
end 


azi = az(1); az = az/azi; bz = bz/azi; 


O EXAMPLE 8.26 Use the zmapping function to perform the lowpass-to-highpass transformation 


>> 
>> 


in Example 8.25. 


First we will design the lowpass digital filter in MATLAB using the bilinear 
transformation procedure and then use the zmapping function. 


4 Digital Lowpass Filter Specifications: 

wplp = 0.2*pi; % digital Passband freq in Hz 

wslp = 0.3*pi; X digital Stopband freq in Hz 
Rp = 1; X Passband ripple in dB 


As * 15; X Stopband attenuation in dB 

% Analog Prototype Specifications: Inverse mapping for frequencies 

T= 1; Fs-1/T; X Set T=1 

OmegaP = (2/1) *tan(wplp/2) ; % Prewarp Prototype Passband freq 
OmegaS = (2/1) *tan(wslp/2) ; X Prewarp Prototype Stopband freq 


% Analog Chebyshev Prototype Filter Calculation: 
[cs,ds] = afd_chbi (OmegaP ,OmegaS ,Rp, As) ; 
Chebyshev-1 Filter Order = 4 


¥, Bilinear transformation: 
(blp,alp] = bilinear (cs,ds,Fs); 


% Digital Highpass Filter Cutoff frequency: 
wphp = 0.6*pi; % Passband edge frequency 


X LP-to-HP frequency-band transformation: 
alpha = -(cos( (wplp+wphp) /2)) / (cos (wplp-wphp) /2)) 


alpha = -0.3820 


>> 
>> 
>> 


Nz = -[alpha,1]; Dz = [1,alpha]; 
[bhp,ahpl = zmapping (blp,alp,Nz,Dz); 
[C,B,A] = dir2cas(bhp,ahp) 


C = 0.0243 
B = 1.0000 -2.0000 1.0000 


1.0000 -2.0000 1.0000 


A = 1.0000 1.0416 0.4019 


1.0000 0.5561 0.7647 


M 7 855 
^ 855 
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The system function of the highpass filter is 


H(z) = 0.0243(1 — 2~1)4 
~ (12-0.5661z-! + 0.7647z-2)(1 + 1.04162-! + 0.40192-2) 


which is essentially identical to that in Example 8.25. [m] 


In Example 8.26 a lowpass prototype digital filter was available to trans- 
form into a highpass filter so that a particular band-edge frequency was 
properly mapped. In practice we have to first design a prototype lowpass 
digital filter whose specifications should be obtained from specifications 
of other frequency-selective filters as given in Figure 8.20. We will now 
show that the lowpass prototype filter specifications can be obtained from 
the transformation formulas given in Table 8.2. 

Let us use the highpass filter of Example 8.25 as an example. The 
passband-edge frequencies were transformed using the parameter o — 
—0.38197 in (8.30). What is the stopband-edge frequency of the highpass 
filter, say ws, corresponding to the stopband edge w, = 0.37 of the pro- 
totype lowpass filter? This can be answered by (8.30). Since a is fixed for 
the transformation, we set the equation 


cos((0.3m + ws)/2] _ 


= ~cos|(0.3m — w,)/2] = —0.38197 


This is a transcendental equation whose solution can be obtained itera- 


tively from an initial guess. It can be done using MATLAB, and the solution 
is 


ws = 0.45867 


Now in practice we will know the desired highpass frequencies w, and 
Wp, and we are required to find the prototype lowpass cutoff frequencies 
w, and wy. We can choose the passband frequency w, with a reasonable 
value, say wp = 0.27, and determine o from wp using the formula from 


Table 8.2. Now w! can be determined (for our highpass filter example) 
from o and 


ztta 


fari 


- ] 
where Z = e/"^ and z = e!"*, or 


"ENS ME adu +a 
het ( anim a) (8.31) 


Continuing our highpass filter example, let wp = 0.67 and w, = 0.45867 be 
the band-edge frequencies. Let us choose w, = 0.27. Then a = —0.38197 
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from (8.30), and from (8.31) 


e7 90-4586" _ 0.38197 \ — 
4,7 Lr ssi om I 


as expected. Now we can design a digital lowpass filter and transform 
it into a highpass filter using the zmapping function to complete our 
design procedure. For designing a highpass Chebyshev-I digital filter, the 
above procedure can be incorporated into a MATLAB function called the 
chebihpf function shown below. 


function [b,a] = chebihpf(wp,ws,Rp,As) 

% IIR Highpass filter design using Chebyshev-1 prototype 
% function [b,a] = chebihpf(wp,ws,Rp,As) 

X4 b= Numerator polynomial of the highpass filter 

% a= Denominator polynomial of the highpass filter 

% wp = Passband frequency in radians 


X4 ws = Stopband frequency in radians 
4 Rp = Passband ripple in dB 
% As = Stopband attenuation in dB 


* 

% Determine the digital lowpass cutoff frequecies: 

wplp = 0.2*pi; 

alpha = -(cos((wplptwp)/2))/(cos((uplp-wp)/2)); 

wslp = angle(-(exp(-j*ws) *alpha)/(1*alpha*exp(-j*ws))); 
4 
% Compute Analog lowpass Prototype Specifications: 
T = 1; Fs = 1/T; 

OmegaP = (2/T)*tan(wplp/2); 

OmegaS = (2/T)*tan(wslp/2); 


% Design Analog Chebyshev Prototype Lowpass Filter: 
[cs,ds] = afd_chb1(OmegaP ,OmegaS ,Rp, As) ; 


% Perform Bilinear transformation to obtain digital lowpass 
[blp,alp) = bilinear (cs ,ds,Fs); 


4 Transform digital lowpass into highpass filter 
Nz = -[alpha,1]; Dz = [1,alpha]; 
[b,a] = zmapping(blp,alp,Nz,Dz); 


We will demonstrate this procedure in the following example. 
Design a highpass digital filter to satisfy 

Wp = 0.67, Rp =1dB 

ws = 0.45867, A, = 15 dB 
Use the Chebyshev-I prototype. 
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MATLAB Script 
>> % Digital Highpass Filter Specifications: 





>> wp = 0.6*pi; 
>> ws = 0.4586*pi; 
>> Rp = 1; 

>> As = 15; 


% digital Passband freq in Hz 
% digital Stopband freq in Hz 
% Passband ripple in dB 

% Stopband attenuation in dB 


>> [b,a] = chebihpf(wp,ws,Rp,As); 

>> (C,B,A] = dir2cas(b,a) 

C = 0.0243 

B= 1.0000 -2.0000 1.0000 
1.0000 -2.0000 1.0000 

A = 1.0000 1.0416 0.4019 
1.0000 0.5561 0.7647 


ae 


The system function is 


0.0243(1 — z~*)* 
(1 3- 0.566127 + 0.76472-?)(1 + 1.04162-! + 0.401927?) 


which is identical to that in Example 8.26. o 


H (z) = 


The above highpass filter design procedure can be easily extended to 
other frequency-selective filters using the transformation functions in Ta- 
ble 8.2. These design procedures are explored in Problems 8.18 through 
8.22. We now describe MATLAB's filter design functions for designing ar- 
bitrary frequency-selective filters. 


In the preceding section we discussed four MATLAB functions to design 
digital lowpass filters. These same functions can also be used to design 
highpass, bandpass, and bandstop filters. The frequency-band transforma- 
tions in these functions are done in the s-plane, that is, they use Approach- 
1 discussed on page 301. For the purpose of illustration we will use the 
function butter. It cari be used with the following variations in its input 
arguments. 


e [b,a] = BUTTER(N,wn, high’) designs an Nth-order highpass fil- 
ter with digital 3-dB cutoff frequency wn in units of 7. 

e [b,a] = BUTTER(N, wn, designs an order 2N bandpass filter if wn is 
a two-element vector, vn-[wi w2], with 3-dB passband wi < w < w2 in 
units of 7. 

e [b,a] = BUTTER(N,wn,'stop') is an order 2N bandstop filter if 
wns[wi w2]with 3-dB stopband wi < w < w2 in units of 7. 


To design any frequency-selective Butterworth filter, we need to know 
the order N and the 3-dB cutoff frequency vector wn. In this chapter we 
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described how to determine these parameters for lowpass filters. However, 


these calculations 


are more complicated for bandpass and bandstop filters. 


In their Signal Processing toolbox, MATLAB provides a function called 
buttord to compute these parameters. Given the specifications, wp, Ws, 
Ry, and As, this function determines the necessary parameters. Its syntax 


is 


[N,wn] = buttord(wp,ws,Rp,As) 


The parameters wp and ws have some restrictions, depending on the type 


of filter: 


e for lowpass filters wp < wS, 

e for highpass filters wp > ws, 

e for bandpass filters wp and ws are two-element vectors, wp=[wp1, 
wp2] and ws={ws1,ws2), such that wsi « wpi < wp2 < ws2, and 

e for bandstop filters wp1 < wsi < ws2 < wp2. 


Now using the buttord function in conjunction with the butter func- 
tion, we can design any Butterworth IIR filter. Similar discussions apply 
for cheby1, cheby2, and ellip functions with appropriate modifications. 


We illustrate the 


O EXAMPLE 828 In this example we 
were given in Example 8.27. 


Solution 


MATLAB Script 


>> % Digital Filter Specifications: 


>> ws = 0.4586*pi; 
>> wp = 0.6*pi; 
>> Rp = 1; 

>> As = 15; 


use of these functions through the following examples. 


will design a Chebyshev-I highpass filter whose specifications 


% Type: Chebyshev-I highpass 
% Dig. stopband edge frequency 
* Dig. passband edge frequency 
X Passband ripple in dB 

X Stopband attenuation in dB 


>> % Calculations of Chebyshev-I Filter Parameters: 
>> {N,wn] = chebiord(wp/pi,ws/pi,Rp,As) ; 


>> X Digital Chebyshev-I Highpass Filter Design: 
>> [b,a] = cheby1(N,Rp,wn, high’); 


>> % Cascade Form Realization: 
>> [b0,B,A] = dir2cas(b,a) 


bO = 0.0243 

B = 1.0000 -1.9991 
1.0000 -2.0009 

A * 1.0000 1.0416 
1.0000 0.5561 


0.9991 
1.0009 
0.4019 
0.7647 
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Frequency-band Transformations 


The cascade form system function 


H()- 0.0243(1 — z~*)4 
~ (14-0.56612-1 + 0.76472-2)(1 + 1.041621 + 0.40192-?) 


is identical to the filter designed in Example 8.27, which demonstrates that 


the two approaches described on page 301 are identical. 'The frequency-domain 
plots are shown in Figure 8.22. n 


O EXAMPLE 829 In this example we will design an elliptic bandpass filter whose specifications 
are given in the following MATLAB script: 


>> * Digital Filter Specifications: X Type: Elliptic Bandpass 

>> ws = [0.3*pi 0.75*pi]; % Dig. stopband edge frequency 
>> wp = [0.4*pi 0.6*pi]; % Dig. passband edge frequency 
>> Rp = 1; % Passband ripple in dB 

>> As = 40; % Stopband attenuation in dB 


>> % Calculations of Elliptic Filter Parameters: 
>> (N,wn] = ellipord(wp/pi,ws/pi,Rp,As) ; 


>> % Digital Elliptic Bandpass Filter Design: 
>> [b,a] = ellip(N,Rp,As,wn); 
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FIGURE 8.22 Digital Chebyshev-I highpass filter in Example 8.28 
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>> % Cascade Form Realization: 
>> [b0,B,A] = dir2cas(b,a) 

bO = 0.0197 

B = 1.0000 1.5066 1.0000 
.0000 0.9268 1.0000 
0000 -0.9268 1.0000 
0000 -1.5066 1.0000 
0000 0.5963 0.9399 
.0000 0.2774 0.7929 
.0000 -0.2774 0.7929 
.0000 -0.5963 0.9399 


> 
LI 
Com m oH oM M UM 


are shown in Figure 8.23. 





Note that the designed filter is a 10th-order filter. The frequency-domain plots 


oO 


O EXAMPLE 8.30 Finally, we will design a Chebyshev-II bandstop filter whose specifications are 


given in the following MATLAB script. 


>> % Digital Filter Specifications: 
>> ws = [0.4*pi O.T*pil; 
>> wp = [0.25*pi 0.8*pi]; 


>> Rp = 1; 
>> As = 40; 
Magnitude Response 
! V 
0.8913 VV 
% 0304 0.6 0.75 i 
frequency in pi units 
Magnitude in dB 
0 rs 








0 0.30.4 0.6 0.75 1 
frequency in pi units 


phase in pi units 


% Type: Chebyshev-II Bandstop 
% Dig. stopband edge frequency 
4 Dig. passband edge frequency 


% Passband ripple in dB 
4% Stopband attenuation in dB 


Phase Response 
1 
0.5 i 
0 
-05 H 
"lg 0304 06075 1 
frequency in pi units 
Group Delay 
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FIGURE 8.23 Digital elliptic bandpass filter in Example 8.29 
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>> % Calculations of Chebyshev-II Filter Parameters: 


>> [N,wn] = cheb2ord(wp/pi,ws/pi,Rp,As); 


>> % Digital Chebyshev-II Bandstop Filter Design: 
>> [b,a] = cheby2(N,As,ws/pi,’stop’); 


>> A Cascade Form Realization: 
>> [b0,B,A] = dir2cas(b,a) 


bO = 0.1558 

B = 1.0000 1.1456 
1.0000 0.8879 
1.0000 0.3511 
1.0000 -0.2434 
1.0000 -0.5768 

A = 1.0000 1.3041 
1.0000 0.8901 
1.0000 0.2132 
1.0000 -0.4713 
1.0000 -0.8936 


This is also a 10th-order filter. The frequency domain plots are shown in Figure 


8.24. 
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FIGURE 8.24 Digital Chebyshev-II bandstop filter in Example 8.30 
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COMPARISON OF FIR VS. HR FILTERS 
_ — 


Comparison of FIR vs. IIR Filters 





So far we have seen many techniques for designing both FIR and IIR 
filters. In practice one wonders about which filter (FIR or IIR) should be 
chosen for a given application and which method should be used to design 
it. Because these design techniques involve different methodologies, it is 
difficult to compare them. However, some meaningful comparisons can be 
attempted if we focus on the minimax optimal (or equiripple) filters. In the 
case of FIR filters these optimal filters are the equiripple filters designed 
via the Parks-McClellan algorithm (or Remez Exchange Algorithm), while 
in the case of IIR filters these are the elliptic filters. 

One basis of comparison is the number of multiplications required to 
compute one output sample in the standard realization of these filters. For 
FIR filters the standard realization is the linear-phase direct form, while 
for elliptic filters cascade forms are widely used. Let M be the length of a 
linear phase FIR filter (assume M odd). Then we need 


multiplications per output sample. Let N (assume N even) be the order 
of an elliptic filter with the cascade form realization. Then there are N/2 
second-order sections, each requiring 3 multiplications (inthe most effi- 
cient implementation). There are an additional three multiplications in 
the overall structure for a total of 


37 +3 = (for large N) 


multiplications per output sample. 

Now if we assume that each filter meets exactly the same specifi- 
cations: (e.g., Wp, Ws, 61 (or passband ripple Rp), and 62 (or stopband 
attenuation As) for a lowpass filter), then these two filters are equivalent 
if 





M+1 3N+3 M 1 
Sige 5 aaa eat a=? for large N 


This means that if the ratio M/N = 3, then two filters are roughly effi- 
cient. However, an equiripple FIR filter is more efficient if M/N < 3, or 
an elliptic IIR filter is more efficient if M /N > 3. 

It has been shown experimentally that 


e for wp > 0.3, M/N 2 3 for all 65, 62, N 
e for N > 10, M/N > 3 for all 61, 62, N 
e for large N, M/N ~ in 100's 
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This shows that for most applications IIR elliptic filters are desirable from 
the computational point of view. The most favorable conditions for FIR 
filters are 


e large values of ó1, 
e small values of 52, and 
e large transition width. 


Furthermore, if we take into account the phase equalizers (which are 
all-pass filters) connected in cascade with elliptic filters that are needed for 
linear-phase characteristics, then FIR equiripple filter designs look good 
because of their exact linear-phase characteristics. 


PROBLEMS 


P8.1 


P8.2 


P8.3 


P8.4 


P8.5 


Design an analog Butterworth lowpass filter that has a 1-dB or better rìpple at 30 rad/sec 
and at least 30 dB of attenuation at 40 rad/sec. Determine the system function in a cascade 
form. Plot the magnitude response, the log-magnitude response in dB, the phase response, 
and the impulse response of the filter. 

Design a lowpass analog elliptic filter with the following characteristics: 


e an acceptable passband ripple of 1 dB, 
e passband cutoff frequency of 10 rad/sec, and 
e stopband attenuation of 40 dB or greater beyond 15 rad/sec. 


Determine the system function in a rational function form. Plot the magnitude response, the 
log-magnitude response in dB, the phase response, and the impulse response of the filter. 


A signal za (t) contains two frequencies, 100 Hz and 130 Hz. We want to suppress the 
130-Hz component to 50-dB attenuation while passing the 100-Hz component with less than 
2-dB attenuation. Design a minimum-order Chebyshev-I analog filter to perform this 
filtering operation. Plot the log-magnitude response and verify the design. 


Design an analog Chebyshev-II lowpass filter that has a 0.5 dB or better ripple at 250 Hz 
and at least 45 dB of attenuation at 300 Hz. Plot the magnitude response, the 
log-magnitude response in dB, the phase response, and the impulse response of the filter. 


Write a MATLAB function to design analog lowpass filters. The format of this function 
should be 


function [b,a] =afd(type,Fp,Fs,Rp,As) 
* 

% function [b,a] -afd(type,Fp,Fs,Rp,As) 

% Designs analog lowpass filters 

% type = ’butter’ or 'chebyi' or ?cheby2’ or 'ellip' 
X Fp = passband cutoff in Hz 

X Fs = stopband cutoff in Hz 

% Rp = passband ripple in dB 

X As = stopband attenuation in dB 


a 
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P8.6 


P8.7 


P8.8 


P8.9 


Use the afd-butt, afd chb1, afd.chb2, and afd elip functions developed in this chapter. 
Check your function on specifications given in Problems 8.1 through 8.4. 


Design a lowpass digital filter to be used in a structure 


«0 —[N5]— [169] PA] — 1» 


to satisfy the following requirements: 


sampling rate of 8000 sam/sec, 

passband edge of 1500 Hz with ripple of 3dB, 
stopband edge of 2000 Hz with attenuation of 40 dB, 
equiripple passband but monotone stopband, and 
impulse invariance method. 


a. Choose T' — 1 in the impulse invariance method and determine the system function H (z) 
in parallel form. Plot the log-magnitude response in dB and the impulse response h (n). 
b. Choose T' — 1/8000 in the impulse invariance method and determine the system function 
ha (s) in parallel form. Plot the log-magnitude response in dB and the impulse response 
h (n). Compare this design with the above one and comment on the effect of T on the 
impulse invariance design. 
Design a Butterworth digital lowpass filter to satisfy these specifications: 

passband edge: 0.47, Ry = 0.5 dB 

stopband edge: 0.67, As= 50 dB 


Use the impulse invariance method with T = 2. Determine the system function in the 
rational form and plot the log-magnitude response in dB. Plot the impulse response h (n) 
and the impulse response ha (t) of the analog prototype and compare their shapes. 

Write a MATLAB function to design digital lowpass filters based on the impulse invariance 
transformation. The format of this function should be 


function [b,al -dlpfd ii(type,wp,ws,Rp,As,T) 

* 

% function [b,a] -dlpfd ii(type,wp,ws,Rp,As,T) 

% Designs digital lowpass filters using impulse invariance 
% type = ?butter' or >chebyl’ 

% wp = passband cutoff in Hz 


% ws = stopband cutoff in Hz 

% Rp = passband ripple in dB 

% As = stopband attenuation in dB 
% T= sampling interval 


Use the afd function developed in Problem 8.5. Check your function on specifications given 
in Problems 8.6 and 8.7. 

In this problem we will develop a technique called the step invariance transformation. In 
this technique the step response of an analog prototype filter is preserved in the resulting 
digital filter; that is, if Ea (t) is the step response of the prototype and if £ (n) is the step 
response of the digital filter, then 


€(n)=£a(t=nT), T : sampling interval 
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P8.10 


P8.11 


P8.12 


a Àu 
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Note that the frequency-domain quantities are related by 


Ea (s) Ê £ [fa (t)] = Ha (s) /s 


z()2 zit) - HG) 1— 


Hence the step invariance transformation steps are as follows: Given H, (s), 


e Divide Ha (s) by s to obtain E, (s). 

e Find residues {Rx} and poles {px} of Za (s). 

e Transform analog poles {px} into digital poles {eT}, where T is arbitrary. 
e Determine € (z) from residues {Rx} and poles {erT}. 

e Determine H (z) by multiplying E (z) by (1 - z) 


Use the above procedure to develop a MATLAB function to implement the step invariance 
transformation. The format of this function should be 


function [b,a] =stp_invr(c,d,T) 


% Step Invariance Transformation from Analog to Digital Filter 
% [b,a] =stp_invr(c,d,T) 

% b= Numerator polynomial in z^(-1) of the digital filter 

% a= Denominator polynomial in z^(-1) of the digital filter 
= Numerator polynomial in s of the analog filter 

- Denominator polynomial in s of the analog filter 

= Sampling (transformation) parameter 


>e 
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Design the lowpass Butterworth digital filter of Problem 8.7 using the step invariance 
method. Plot the log-magnitude response in dB and compare it with that in Problem 8.7. 
Plot the step response £ (n) and the impulse response £a (t) of the analog prototype and 
compare their shapes. 

Consider the design of the lowpass Butterworth filter of Problem 8:7. 


a. Use the bilinear transformation technique outlined in this chapter and the bilinear 
function. Plot the log-magnitude response in dB. Compare the impulse responses of the 
analog prototype and the digital filter. 

b. Use the butter function and compare this design with the above one. 


Following the procedure used in this chapter, develop the following MATLAB functions to 
design FIR filters via the Kaiser window technique. These functions should check for the 
valid band-edge frequencies and restrict the filter length to 255. 


a. Lowpass filter: The format should be 
function [h,M] = kai lpf(wp,ws,As); 
% [h,M] = kai .lpf(wp,ws,As); 


4 Low-Pass FIR filter design using Kaiser window 


% h = Impulse response of length M of the designed filter 





X4 M = Length of h which is an odd number 

% wp = Pass-band edge in radians (0 < wp « ws < pi) 
X4 ws = Stop-band edge in radians (0 < wp < «s < pi) 
% As = Stop-band attenuation in dB (As > 0) 


b. Highpass filter: The format should be 


function [h,M] = kai_hpf (ws, wp, As); 
% [hM] = kai_hpf(ws,wp,As); 
% HighPass FIR filter design using Kaiser window 


= Impulse response of length M of the designed filter 
= Length of h which is an odd number 

= Stop-band edge in radians (0 < wp < ws < pi) 

= Pass-band edge in radians (0 < wp < ws < pi) 

= Stop-band attenuation in dB (As > 0) 


ARN 
pao =e 


c. Bandpass filter: The format should be 


function [h,M] = kai bpf(wsi,wpi,vp2, 82,5) ; 

% (OM = kai_bpf (ws1,wp1,wp2,ws2,As); 

* Band-Pass FIR filter design using Kaiser window 
i h = Impulse response of length M of the designed filter 
% M= Length of h which is an odd number 

% wsi = Lower stop-band edge in radians 

*4 wpi = Lower pass-band edge in radians 

% wp2 = Upper pass-band edge in radians 

X ws2 = Upper stop-band edge in radians 

* 0 < wsi < wpi < wp2 < ws2< pi 

% As = Stop-band attenuation in dB (As > 0) 


d. Bandstop filter: The format should be 


function [h,M] = kai_bsf(wpi,ws1,ws2,wp2,As); 

% OM = kai_bsf(wp1,ws1,ws2,wp2,As); 

%, Band-Pass FIR filter design using Kaiser window 
i h = Impulse response of length M of the designed filter 
% M= Length of h which is an odd number 

% wpi = Lower stop-band edge in radians 

% wei = Lower pass-band edge in radians 

4 ws2 = Upper pass-band edge in radians 

% wp2 = Upper stop-band edge in radians 

A 0 < wpi < wsi < ws2 < wp2 < pi 

% As = Stop-band attenuation in dB (As > 0) 


You can now develop similar functions for other windows discussed in this chapter. 
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Problems 





P8.13 Design the analog Chebyshev-I filter of Problem 8.6 using the bilinear transformation 
method. Compare the two designs. 


Design a digital lowpass filter using elliptic prototype to satisfy these requirements: 
passband edge: 0.47, Rp=1 dB 
stopband edge: 0.5%, As = 60 dB 


Use the bilinear as well as the ellip function and compare your designs. 
Design a digital lowpass filter to satisfy these specifications: 


passband edge: 0.37, Rp =0.5 dB 
stopband edge: 0.47, As = 50 dB 


a. Use the butter function and determine the order N and the actual minimum stopband 
attenuation in dB. 


b. Use the cheby1 function and determine the order N and the actual minimum stopband 
attenuation in dB. 


c. Use the cheby2 function and determine the order N and the actual minimum stopband 
attenuation in dB. 


d. Use the ellip function and determine the order N and the actual minimum stopband 
attenuation in dB. 


e. Compare the orders, the actual minimum stopband attenuations, and the group delays in 
each of the above designs. 


Write a MATLAB function to determine the lowpass prototype digital filter frequencies from 
a highpass digital filter’s specifications using the procedure outlined in this chapter. The 
format of this function should be 


function [wpLP,wsLP,alpha] = hp2lpfre(wphp,wshp) 

X Band-edge frequency conversion from highpass to lowpass digital filter 
% [wpLP,wsLP,a] = hp2lpfre(wphp,wshp) 

% wpLP = passband egde for the lowpass prototype 

% wsLP = stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 

% wphp = passband egde for the highpass 

X wshp = passband egde for the highpass 


Using this function, develop a MATLAB function to design a highpass digital filter using the 
bilinear transformation. The format of this function should be 


function [b,a] = dhpfd_bl(type,wp,ws,Rp,As) 

X IIR Highpass filter design using bilinear transformation 
% [b,a] = dhpfd_bl(type,wp,ws,Rp,As) 

% type = 'butter' or ’chebyl’ or !|chevy2! or 'ellip' 

X b = Numerator polynomial of the highpass filter 

X a = Denominator polynomial of the highpass filter 

% wp = Passband frequency in radians 

% ws = Stopband frequency in radians (wp < ws) 


NN aaacaaaaaamaaaŘħŘħŘħ— 
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% Rp = Passband ripple in dB 
X As = Stopband attenuation in dB 


Verify your function using the specifications in Example 8.27. 
Design a highpass filter to satisfy these specifications: 
stopband edge: 0.47, A, = 60 dB 
passband edge: 0.67, Rp = 0.5 dB 


a. Use the dhpfd_b1 function of Problem 8.16 and the elliptic prototype to design this filter. 
Plot the log-magnitude response in dB of the designed filter. 


b. Use the ellip function for design and plot the log-magnitude response in dB. Compare 
these two designs. 

Write a MATLAB function to determine the lowpass prototype digital filter frequencies from 
an arbitrary lowpass digital filter’s specifications using the functions given in Table 8.2 and 
the procedure outlined for highpass filters. The format of this function should be 


function [wpLP,wsLP,alpha] = 1p21pfre(wplp,wslp) 

% Band-edge frequency conversion from lowpass to lowpass digital filter 
% (wpLP,wsLP,a] = 1p2lpfre(wplp,wslp) 

% wpLP = passband egde for the lowpass prototype 

4 wsLP = stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 

% wplp = passband egde for the lowpass 

4 welp = passband egde for the lowpass 


Using this function, develop a MATLAB function to design a bandpass filter from a 
prototype lowpass digital filter using the bilinear transformation. The format of this 
function should be 


function [b,a] = dbpfd_bl(type,wp,ws,Rp,As) 

% IIR bandpass filter design using bilinear transformation 

X [b,a] = dbpfd_bl (type, wp,ws,Rp,As) 

% type = "butter? or ’chebyi’ or *chevy2’ or *ellip’ 

* b = Numerator polynomial of the bandpass filter 

* a = Denominator polynomial of the bandpass filter 

Passband frequency vector [wp- lower, wp_upper] in radians 
Stopband frequency vector [vp-lower, wp.upper] in radians 
4 Rp = Passband ripple in dB 

% As = Stopband attenuation in dB 


E 
"ow 


Verify your function using the designs in Problem 8.15. 


P8.19 Design a bandpass digital filter using the Cheby2 function. The specifications are 


lower stopband edge: 0.37 A, — 50 dB 
upper stopband edge: 0.67 
lower passband edge: 0.47 R, =0.5 dB 
upper passband edge: 0.57 


Plot the impulse response and the log-magnitude response in dB of the designed filter. 
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P8.20 Write a MATLAB function to determine the lowpass prototype digital filter frequencies from 
a bandpass digital filter's specifications using the functions given in Table 8.2 and the 
procedure outlined for highpass filters. The format of this function should be 


P8.21 


P8.22 


function [wpLP,wsLP,alpha] = bp2lpfre(wpbp,wsblp) 

4 Band-edge frequency conversion from bandpass to lowpass digital filter 

% EwpLP,wsLP,a] = bp2lpfre(wpbp,wsbp) 

X wpLP = passband egde for the lowpass prototype 

% wsLP = stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 

% wpbp = passband egde frequency vector [wp lower, wp.upper] for the bandpass 
X wsbp = passband egde frequency vector [ws lower, ws upper] for the bandpass 


Using this function, develop a MATLAB function to design a bandpass filter from & 
prototype lowpass digital filter using the bilinear transformation. The format of this 
function should be 


function [b,a] = dbpfd_bl(type ,wp,ws,Rp, As) 

% IIR bandpass filter design using bilinear transformation 

% [b,a] = dbpfd_bl(type,wp,ws,Rp,As) 

X type = ’butter’ or ’chebyl’ or *chevy2’ or 'ellip' 

b = Numerator polynomial of the bandpass filter 

a = Denominator polynomial of the bandpass filter 

= Passband frequency vector (wp_lower, wp_upper] in radians 
ws = Stopband frequency vector [wp.lower, wp upper] in radians 
= Passband ripple in dB 

As = Stopband attenuation in dB 


PE el $2 3S 2$ Tf 
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Verify your function using the design in Problem 8.19. 


We wish to use the Chebyshev-I prototype to design a bandpass IIR digital filter that meets 
the following specifications: 


0.95 < |H (e/")| < 1.05, 0 < |w] < 0.257 
0<|H (c%)| < 0.01, 035 < |u| < 0.657 
0.95 < |H (e™)| < 1.05, 0.757 < wl < x 
Use the cheby1 function and determine the system function H (z) of such a filter. Provide a 


plot containing subplots of the log-magnitude response in dB and the impulse response. 


Write a MATLAB function to determine the lowpass prototype digital filter frequencies from 
a bandstop digital filter’s specifications using the functions given in Table 8.2 and the 
procedure outlined for highpass filters. The format of this function should be 


function [wpLP,wsLP,alpha] = bs2lpfre(wpbp,wsblp) 

X Band-edge frequency conversion from bandstop to lowpass digital filter 
X [wpLP,wsLP,a] = bs2lpfre(wpbp,wsbp) 

% wpLP = passband egde for the lowpass prototype 
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P8.23 


P8.24 


P8.25 


% wsLP = stopband egde for the lowpass prototype 

% alpha = lowpass to highpass transformation parameter 

% wpbp = passband egde frequency vector [wp_lower, wp.upper] for the bandstop 
4 wsbp = passband egde frequency vector [ws lower, ws upper] for the bandstop 


Using this function, develop a MATLAB function to design a bandstop filter from a 
prototype lowpass digital filter using the bilinear transformation. The format of this 
function should be 


function [b,a] = dbsfd_bi (type, wp,ws,Rp, As) 

X IIR bandstop filter design using bilinear transformation 

% [b,a] = dbsfd bl(type,wp,ws,Rp,As) 

% type = 'butter' or !chebyi! or ’chevy2’ or ?ellip’ 

* b - Numerator polynomial of the bandstop filter 

Denominator polynomial of the bandstop filter 

Passband frequency vector {wp_lower, wp_upper} in radians 
% ws = Stopband frequency vector {wp_lower, wp_upper] in radians 
% Rp = Passband ripple in dB 

% As = Stopband attenuation in dB 


- 34 
d» 
on 


Verify your function using the design in Problem 8.21. 
An analog signal 

£a (t) = 5sin (200nt) + 2cos (300nt) 
is to be processed by a 


n0 — [| [76] [9/5] e 


system in which the sampling frequency is 1000 sam/sec. 

a. Design a minimum-order IIR digital filter that will pass the 150-Hz component with 
attenuation of less than 1 dB and suppress the 100-Hz component to at least 40 dB. The 
filter should have a monotone passband and an equiripple stopband. Determine the system 
function in rational function form and plot the log-magnitude response. 


b. Generate 300 samples (sampled at 1000 sam/sec) of the above signal £a (t) and process 
through the designed filter to obtain the output sequence. Interpolate this sequence (using 
any one of the interpolating techniques discussed in Chapter 3) to obtain ya (t). Plot the 
input and the output signals and comment on your results. 


Using the bilinear transformation method, design à tenth-order elliptic bandstop filter to 
remove the digital frequency w = 0.447 with bandwidth of 0.087. Choose a reasonable value 
for the stopband attenuation. Plot the magnitude response. Generate 201 samples of the 
sequence 

z (n) = sin [0.44mn], n=0,.-- , 200 
and process thorough the bandstop filter. Comment on your results. 
Design a digital highpass filter H(z) to be used in a 


„0 — [89] — [£8] BA] 0 


structure to satisfy the following requirements 





e sampling rate of 10 Khz, 
e stopband edge of 1.5 Khz with attenuation of 40 dB, 
e passband edge of 2 Khz with ripple of 3dB, 

e monotone passband and stopband, and 

e impulse invariance transformation method. 


a. Plot magnitude response of the overall analog filter over the [0, 5 Khz] interval. 
b. Plot the magnitude response of the digital lowpass prototype. 
c. Plot the magnitude response of the analog lowpass prototype. 


d. What limitations must be placed on the inj i 
! put signals so that the ab 
acts like a highpass filter to them? er ee 


372 
Chapter 8 @ IIR FILTER DESIGN 





APPLICATIONS IN 
ADAPTIVE 
FILTERING 


In Chapters 7 and 8 we described methods for designing FIR. and IIR digi- 
tal filters to satisfy some desired specifications. Our goal was to determine 
the coefficients of the digital filter that met the desired specifications. 

In contrast to the filter design techniques considered in those two 
chapters, there are many digital signal processing applications in which 
the filter coefficients cannot be specified a priori. For example, let us con- 
sider a high-speed modem that is designed to transmit data over telephone 
channels. Such a modem employs & filter called a channel equalizer to com- 
pensate for the channel distortion. The modem must effectively transmit 
data through communication channels that have different frequency re- 
sponse characteristics and hence result in different distortion effects. The 
only way in which this is possible is if the channel equalizer has adjustable 
coefficients that can be optimized to minimize some measure of the dis- 
tortion, on the basis of measurements performed on the characteristics of 
the channel. Such a filter with adjustable parameters is called an adaptive 
filter, in this case an adaptive equalizer. 

Numerous applications of adaptive filters have been described in the 
literature. Some of the more noteworthy applications include (1) adaptive 
antenna systems, in which adaptive filters are used for beam steering and 
for providing nulls in the beam pattern to remove undesired interference 
[23}; (2) digital communication receivers, in which adaptive filters are 
used to provide equalization of intersymbol interference and for channel 
identification [18]; (3) adaptive noise canceling techniques, in which an 
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adaptive filter is used to estimate and eliminate a noise component in 
some desired signal [22, 10, 14]; and (4) system modeling, in which an 
adaptive filter is used as a model to estimate the characteristics of an 
unknown system. These are just a few of the best known examples on the 
use of adaptive filters. 

Although both IIR and FIR filters have been considered for adap- 
tive filtering, the FIR filter is by far the most practical and widely used. 
The reason for this preference is quite simple. The FIR filter has only 
adjustable zeros, and hence it is free of stability problems associated with 
adaptive IIR filters that have adjustable poles as well as zeros. We should 
not conclude, however, that adaptive FIR filters are always stable. On the 
contrary, the stability of the filter depends critically on the algorithm for 
adjusting its coefficients. 

Of the various FIR filter structures that we may use, the direct form 
and the lattice form are the ones often used in adaptive filtering appli- 
cations. The direct form FIR filter structure with adjustable coefficients 
h(0), h(1),. .., h(N — 1) is illustrated in Figure 9.1. On the other hand, 
the adjustable parameters in an FIR lattice structure are the reflection 
coefficients Kn shown in Figure 6.18. 

An important consideration in the use of an adaptive filter is the 
criterion for optimizing the adjustable filter parameters. The criterion 
must not only provide a meaningful measure of filter performance, but it 
must also result in a practically realizable algorithm. 

One criterion that provides a good measure of performance in adap- 
tive filtering applications is the least-squares criterion, and its counterpart 
in a statistical formulation of the problem, namely, the mean-square-error 
(MSE) criterion. The least squares (and MSE) criterion results in a qua- 
dratic performance index as a function of the filter coefficients, and hence 
it possesses a single minimum. The resulting algorithms for adjusting the 
coefficients of the filter are relatively easy to implement. 








Output 


PETS 


FIGURE 9.1 Direct form adaptive FIR filter 
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In this chapter we describe a basic algorithm, called the least-mean- 
square (LMS) algorithm, to adaptively adjust the coefficients of an FIR 
filter. The adaptive filter structure that will be implemented is the di- 
rect form FIR filter structure with adjustable coefficients h(0), h(1),..., 
h(N — 1), as illustrated in Figure 9.1. After we describe the LMS algo- 
rithm, we apply it to several practical systems in which adaptive filters 
are employed. 


LMS ALGORITHM FOR COEFFICIENT ADJUSTMENT 
I —— 


Suppose we have an FIR filter with adjustable coefficients {h(k),0<k < 
N — 1}. Let {x(n)} denote the input sequence to the filter, and let the 
corresponding output be {y(n)}, where 


N-1 : 
y(n) = Y h(k)z(n—k), n=0,...,.M (9.1) 
k=0 
Suppose that we also have a desired sequence {d(n)} with which we can 
compare the FIR filter output. Then we can form the error sequence 
{e(n)} by taking the difference between d(n) and y(n). That is, 
e(n) = d(n)- y(n), n=0,... ,M (9.2) 


The coefficients of the FIR filter will be selected to minimize the sum of 
squared errors. Thus we have 


M M N-1 
eoo o- Erwan (9.3) 
k=0 


E (n) me (k) + Y AMT (k — £) 
n=0 k=0 à k=0 @=0 
where, by definition, 
ras (8) = Ydi), O<k<N-1 (9.4) 
n=0 
ra) = Soe (n) 2 (n+), O<k<N-1 (9.5) 
n=0 
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We call (ra; (k)) the crosscorrelation between the desired output sequence 
(d(n)) and the input sequence {x(n)}, and (rz(k)] is the autocorrelation 
sequence of {z(n)}. 

The sum of squared errors £ is a quadratic function of the FIR filter 
coefficients. Consequently, the minimization of € with respect to the filter 
coefficients {h(k)} results in a set of linear equations. By differentiating 
£ with respect to each of the filter coefficients, we obtain 


oE 
——— = < < -— B 
Sh (m) 0 O<m<N-1 (9.6) 
and, hence 
N-1 
Y h(k) ras (k — m) = ras (m), 0<m<N-1 (9.7) 
k=0 


This is the set of linear equations that yield the optimum filter coefficients. 

To solve the set of linear equations directly, we must first compute 
the autocorrelation sequence (rz. (k)) of the input signal and the cross- 
correlation sequence {raz(k)} between the desired sequence {d(n)} and 
the input sequence {zx (n)]. 

The LMS algorithm provides an alternative computational method for 
determining the optimum filter coefficients {h(k)} without explicitly com- 
puting the correlation sequences {roz(k)} and {raz(k)}. The algorithm is 
basically a recursive gradient (steepest-descent) method that finds the 
minimum of € and thus yields the set of optimum filter coefficients. 

We begin with any arbitrary choice for the initial values of {h(k)}, 
say {ho(k)}. For example, we may begin with ho(k) 20, O<k<N-1. 
Then after each new input sample {x (n)) enters the adaptive FIR filter, 
we compute the corresponding output, say {y(n)}, form the error signal 
e(n) = d(n) — y(n), and update the filter coefficients according to the 
equation 


hn (k) = hai (k) + A-e(n)-2(n—k), O<k<N-1, n=0,1,... 
(9.8) 


where A is called the step size parameter, z(n— k) is the sample of the in- 
put signal located at the kth tap of the filter at time n, and e (n) z (n — k) 
is an approximation (estimate) of the negative of the gradient for the kth 
filter coefficient. This is the LMS recursive algorithm for adjusting the fil- 
ter coefficients adaptively so as to minimize the sum of squared errors E. 

The step size parameter A controls the rate of convergence of the 
algorithm to the optimum solution. A large value of A leads to large 
step size adjustments and thus to rapid convergence, while a small value 
of A results in slower convergence. However, if A is made too large the 
algorithm becomes unstable. To ensure stability, A must be chosen [18] 
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to be in the range i 


1 

LL 9.9 
0cA« (NE, (9.9) 
where N is the length of the adaptive FIR filter and P, is the power in 
the input signal, which can be approximated by 


M 
slo ed = tO 9.10 
ius) Pu (n) = M31 (9.10) 


n=0 


The mathematical justification of equations (9.9) and (9.10) and the 
proof that the LMS algorithm leads to the solution for the optimum filter 
coefficients is given in more advanced treatments of adaptive filters. The 
interested reader may refer to the books by Haykin [9] and Proakis (18). 


The LMS algorithm (9.8) can easily be implemented in MATLAB. Given 
the input sequence {x (n)), the desired sequence (d (n)), step size A, and 
the desired length of the adaptive FIR filter N, we can use (9.1), (9.2), and 
(9.8) to determine the adaptive filter coefficients {h(n),O0<n<N—- 1} 
recursively. This is shown in the following function called 1ms. 


4, momen 
% h, y] = ims(x,d,delta,N) 
* h = estimated FIR filter 


4 y = output array y(n) 

% x = input array x(n) 

* d = desired array d(n), length must be same as X 
% delta = step size 

% N = length of the FIR filter 


* 
M = length(x); y = zeros (1,M); 
h = zeros(1,N); 
for n = N:M 
xi = x(n:-1:n-N*1); 
y=h*xl; 
e = d(n) - y; 
h = h + deltate*xi; 
end 


In addition, the 1ms function provides the output (y (n)) of the adaptive 
filter. 

Below, we apply the LMS algorithm to several practical applications 
involving adaptive filtering. 
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SYSTEM IDENTIFICATION OR SYSTEM MODELING 
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PROJECT 9.1: 
SYSTEM 
IDENTIFI- 
CATION 
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To formulate the problem, let us refer to Figure 9.2. We have an unknown 
linear system that we wish to identify. The unknown system may be an 
all-zero (FIR) system or a pole-zero (IIR) system. The unknown system 
will be approximated (modeled) by an FIR filter of length N. Both the 
unknown system and the FIR model are connected in parallel and are 
excited by the same input sequence {z (n)}. If (y (n)} denotes the output 
of the model and (d (n)) denotes the output of the unknown system, the 
error sequence is {e(n) = d(n) — y(n)}. If we minimize the sum of squared 
errors, we obtain the same set of linear equations as in (9.7). Therefore the 
LMS algorithm given by (9.8) may be used to adapt the coefficients of the 
dn model so that its output approximates the output of the unknown 
system. 


There are three basic modules that are needed to perform this project. 


1. A noise signal generator that generates a sequence of random num- 
bers with zero mean value. For example, we may generate a sequence of 
uniformly distributed random numbers over the interval [-a, a]. Such a 
sequence of uniformly distributed numbers has an average value of zero 
and a variance of a?/3. This signal sequence, call it (z(n)), will be used 
as the input to the unknown system and the adaptive FIR model. In this 
case the input signal (z(n)) has power P, = a?/3. In MATLAB this can 
be implemented using the rand function. 

2. An unknown system module that may be selected is an IIR filter 
and implemented by its difference equation. For example, we may select 
an IIR filter specified by the second-order difference equation 


d (n) = aid (n — 1) - aod (n — 2) +2 (n) biz (n — 1) bo (n — 2) (9.11) 
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FIGURE 9.2 Block diagram of system identification or system modeling problem 
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where the parameters (a1,a2) determine the positions of the poles and 
{b,, b2} determine the positions of the zeros of the filter. These parame- 
ters are input variables to the program. This can be implemented by the 
filter function. 

3. An adaptive FIR filter module where the FIR filter has N tap co- 
efficients that are adjusted by means of the LMS algorithm. The length N 
of the filter is an input variable to the program. This can be implemented 
using the 1ms function given in the previous section. 


The three modules are configured as shown in Figure 9.2. From this 
project we can determine how closely the impulse response of the FIR 
model approximates the impulse response of the unknown system after 
the LMS algorithm has converged. 

To monitor the convergence rate of the LMS algorithm, we may com- 
pute a short-term average of the squared error e? (n) and plot it. That is, 
we may compute 


n+K 
ASE(m) = x 3 e? (k) (9.12) 
k=n+1 


where m = n/K = 1,2,.... The averaging interval K may be selected 
to be (approximately) K = 10N. The effect of the choice of the step 
size parameter A on the convergence rate of the LMS algorithm may be 
observed by monitoring the ASE (m). 

Besides the main part of the program, you should also include, as an 
aside, the computation of the impulse response of the unknown system, 
which can be obtained by exciting the system with a unit sample sequence 
6 (n). This actual impulse response can be compared with that of the FIR 
model after convergence of the LMS algorithm. The two impulse responses 
can be plotted for the purpose of comparison. 


SUPPRESSION OF NARROWBAND INTERFERENCE 
IN A WIDEBAND SIGNAL 


Let us assume that we have a signal sequence {x(n)} that consists of 
a desired wideband signal sequence, say {w (n)}, corrupted by an ad- 
ditive narrowband interference sequence {s (n)}. The two sequences are 
uncorrelated. This problem arises in digital communications and in signal 
detection, where the desired signal sequence {w (n)) is a spread-spectrum 
signal, while the narrowband interference represents a signal from another 
user of the frequency band or some intentional interference from a jammer 
who is trying to disrupt the communication or detection system. 
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From a filtering point of view, our objective is to design a filter that 
suppresses the narrowband interference. In effect, such a filter should place 
a notch in the frequency band occupied by the interference. In practice 
however, the frequency band of the interference might be unknown. More- 
over, the frequency band of the interference may vary slowly in time. 

The narrowband characteristics of the interference allow us to esti- 
mate s(n) from past samples of the sequence x(n) = s(n) + w(n) and to 
subtract the estimate from x(n). Since the bandwidth of {s(n)} is nar- 
row compared to the bandwidth of {w(n)}, the samples of {s(n)} are 
highly correlated. On the other hand, the wideband sequence {w (n)) has 
a relatively narrow correlation. 

The general configuration of the interference suppression system is 
shown in Figure 9.3. The signal z (n) is delayed by D samples, where the 
delay D is chosen sufficiently large so that the wideband signal compo- 
nents w(n) and w(n — D), which are contained in x(n) and z(n — D) 
respectively, are uncorrelated. The output of the adaptive FIR filter is 
the estimate 


N-1 
a(n) = Y h(k)z(n -k — D) (9.13) 
k=0 


The error signal that is used in optimizing the FIR filter coefficients is 
e(n) = x(n) — 3(n). The minimization of the sum of squared errors again 
leads to a set of linear equations for determining the optimum coefficients 
Due to the delay D, the LMS algorithm for adjusting the coefficients 
recursively becomes 


k-0,1,...,N-1 


halk) Lm hs (k) + Ae(n)z(n -k- D) ? -12 


(9.14) 


pu 


D FIR filter 
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FIGURE 9.3 Adaptive filter for estimating and suppressing a narrowband inter- 


ference 
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PROJECT 9.2: 
SUPPRESSION 
OF 

SINUSOIDAL 
INTERFERENCE 


Suppression of Narrowband Interference in a Wideband Signal 





There are three basic modules required to perform this project. 


1. A noise signal generator module that generates a wideband se- 
quence {w (n)) of random numbers with zero mean value. In particular, 
we may generate a sequence of uniformly distributed random numbers 
using the rand function as previously described in the project on system 
identification. The signal power is denoted as Py. 

2. A sinusoidal signal generator module that generates a sine wave se- 
quence s(n) = Asinwon, where 0 < wo < 7 and A is the signal amplitude. 
The power of the sinusoidal sequence is denoted as Ps. 

3. An adaptive FIR filter module using the 1ms function, where the 
FIR filter has N tap coefficients that are adjusted by the LMS algorithm. 
The length N of the filter is an input variable to the program. 


The three modules are configured as shown in Figure 9.4. In this 
project the delay D = 1is sufficient, since the sequence {w (n)} is a white 
noise (spectrally flat or uncorrelated) sequence. The objective is to adapt 
the FIR filter coefficients and then to investigate the characteristics of the 
adaptive filter. 

It is interesting to select the interference signal to be much stronger 
than the desired signal w(n), for example, P, = 10P,. Note that the 
power P, required in selecting the step size parameter in the LMS algo- 
rithm is P, = P, + Pw. The frequency response characteristic H (e%”) of 
the adaptive FIR filter with coefficients {h(k)} should exhibit a resonant 
peak at the frequency of the interference. The frequency response of the 
interference suppression filter is Hs ev) =1-H (e), which should, 
then exhibit a notch at the frequency of the interference. 2, - |^? ; 

It is interesting to plot the sequences {w (n)), {s (n)}, and {x(n)}. It 
is also interesting to plot the frequency responses H (e^) and H, (e") 
after the LMS algorithm has converged. The short-time average squared 
error ASE (m), defined by (9.12), may be used to monitor the conver- 
gence characteristics of the LMS algorithm. The effect of the length of 
the adaptive filter on the quality of the estimate should be investigated. 


Sine wave 
generator 


Noise E x Adaptive n" 
generator D=1 FIR filter 


FIGURE 9.4 Configuration of modules for experiment on interference suppres- 
sion 
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The project may be generalized by adding a second sinusoid of a differ- 
ent frequency. Then H (e?) should exhibit two resonant peaks, provided 
the frequencies are sufficiently separated. Investigate the effect of the filter 
length N on the resolution of two closely spaced sinusoids. 


ADAPTIVE LINE ENHANCEMENT 
——————————A— — 


PROJECT 9.3: 
ADAPTIVE 

LINE 
ENHANCEMENT 


In the preceding section we described a method for suppressing a strong 
narrowband interference from a wideband signal. An adaptive line en- 
hancer (ALE) has the same configuration as the interference suppression 
filter in Figure 9.3, except that the objective is different. 

In the adaptive line enhancer, (s(n)) is the desired signal and (w(n)) 
represents a wideband noise component that masks {s(n)}. The desired 
signal (s(n)) may be a spectral line (a pure sinusoid) or a relatively 
narrowband signal. Usually, the power in the wideband signal is greater 
than that in the narrowband signal—that is, Pe > Ps. It is apparent that 
the ALE is a self-tuning filter that has a peak in its frequency response 
at the frequency of the input sinusoid or in the frequency band occupied 
by the narrowband signal. By having a narrow bandwidth FIR filter, the 
noise outside the frequency band of the signal is suppressed, and thus 
the spectral line is enhanced in amplitude relative to the noise power in 


{w(n)}. 


This project requires the same software modules as those used in the 
project on interference suppression. Hence the description given in the 
preceding section applies directly. One change is that in the ALE, the 
condition is that P,, > P,. Secondly, the output signal from the ALE is 


{s(n)}. Repeat the project described in the previous section under these 
conditions. 


ADAPTIVE CHANNEL EQUALIZATION 
J 
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The speed of data transmission over telephone channels is usually limited 
by channel distortion that causes intersymbol interference (ISI). At data 
rates below 2400 bits the ISI is relatively small and is usually not a prob- 
lem in the operation of a modem. However, at data rates above 2400 bits, 
an adaptive equalizer is employed in the modem to compensate for the 
channel distortion and thus to allow for highly reliable high-speed data 
transmission. In telephone channels, filters are used throughout the sys- 
tem to separate signals in different frequency bands. These filters cause 
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PROJECT 9.4: 
ADAPTIVE 
CHANNEL 
EQUALIZATION 


amplitude and phase distortion. The adaptive equalizer is basically an 
adaptive FIR filter with coefficients that are adjusted by means of the 
LMS algorithm to correct for the channel distortion. 

A block diagram showing the basic elements of à modem transmit- 
ting data over a channel is given in Figure 9.5. Initially, the equalizer 
coefficients are adjusted by transmitting a short training sequence, usu- 
ally less than one second in duration. After the short training period, 
the transmitter begins to transmit the data sequence fa(n)). To track 
the possible slow time variations in the channel, the equalizer coefficients 
must continue to be adjusted in an adaptive manner while receiving data. 
This is usually accomplished, as illustrated in Figure 9.5, by treating the 
decisions at the output of the decision device as correct, and using the 
decisions in place of the reference {d(n)} to generate the error signal. This 
approach works quite well when decision errors occur infrequently, such 
as less than one error in 100 data symbols. The occasional decision errors 
cause only a small misadjustment in the equalizer coefficients. 


The objective of this project is to investigate the performance of an adap- 
tive equalizer for data transmission over a channel that causes intersym- 
bol interference. The basic configuration of the system to be simulated 
is shown in Figure 9.6. As we observe, five basic modules are required. 
Note that we have avoided carrier modulation and demodulation, which 
is required in a telephone channel modem. This is done to simplify the 
simulation program. However, all processing involves complex arithmetic 
operations. 

' The five modules are as follows: 


1. The data generator module is used to generate a sequence of 
complex-valued information symbols (a(n)). In particular, employ four 
equally probable symbols s + js, $ — js, —s- js, and —s — js, where s is 
a scale factor that may be set to s = 1, or it can be an input parameter. 
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FIGURE 9.5 Application of adaptive filtering to adaptive channel equalization 
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FIGURE 9.6 Experiment for investigating the performance of an adaptive equal- 
izer 


2. The channel filter module is an FIR filter with coefficients {c(n), 
0< n < K —1) that simulates the channel distortion. For distortionless 
transmission, set c(0) = 1 and c(n) = 0 for 1 < n < K — 1. The length K 
of the filter is an input parameter. 

3. The noise generator module is used to generate additive noise that 
is usually present in any digital communication system. If we are modeling 
noise that is generated by electronic devices, the noise distribution should 
be Gaussian with zero mean. Use the randu function. : 

4. The adaptive equalizer module is an FIR filter with tap coefficients 
(h(k), 0 < k < N — 1), which are adjusted by the LMS algorithm. How- 
ever, due to the use of complex arithmetic, the recursive equation in the 
LMS algorithm is slightly modified to 


hn(k) = hai (k) + A e(n)z* (n — k) (9.15) 


where the asterisk denotes the complex conjugate. 

5. The decision device module takes the estimate @(n) and quantizes 
it to one of the four possible signal points on the basis of the following 
decision rule: 


Re[á(n) »0 and Im[a(n)]}>0 — 1+ 3 
Re(á(n) >0 and Im[à(n)) <0 
Re(4(n) « 0 and Im[à(n) |» 0 -14+j 
Re[á(n] «0 and Imfâ(n}<0 — -1~j 
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The effectiveness of the equalizer in suppressing the ISI introduced by 
the channel filter may be seen by plotting the following relevant sequences 
in a two-dimensional (real-imaginary) display. The data generator out- 
put {a(n)} should consist of four points with values +1 + j. The effect 
of channel distortion and additive noise may be viewed by displaying 
the sequence {x(n)} at the input to the equalizer. The effectiveness of 
the adaptive equalizer may be assessed by plotting its output {a(n)} af- 
ter convergence of its coefficients. The short-time average squared error 
ASE(n) may also be used to monitor the convergence characteristics of 
the LMS algorithm. Note that a delay must be introduced into the output 
of the data generator to compensate for the delays that the signal encoun- 
ters due to the channel filter and the adaptive equalizer. For example, this 
delay may be set to the largest integer closest to (N + K)/2. Finally, an 
error counter may be used to count the number of symbol errors in the 
received data sequence, and the ratio for the number of errors to the total 
number of symbols (error rate) may be displayed. The error rate may be 
varied by changing the level of the ISI and the level of the additive noise. 

It is suggested that simulations be performed for the following three 
channel conditions: 


a. NoISI:  c(0)=1,e(n)=0,1<n<K-1 

b. Mild ISI: c(0) = 1, c(1) = 0.2, c(2) = —0.2, cn) =0,3<n< 
K-1 

c. Strong ISI: c(0) = 1, c(1) = 0.5, c(2) = 0.5, c(n) 20,3 <n € K-1 


The measured error rate may be plotted as a function of the signal- 
to-noise ratio (SNR) at the input to the equalizer, where SNR is defined 
as P,/P,, where P, is the signal power, given as P, = 8, and P, is the 
noise power of the sequence at the output of the noise generator. 
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Summary 


In this chapter we introduced the reader to the theory and implemen- 
tation of adaptive FIR filters with applications to system identification, 
interference suppression, narrowband frequency enhancement, and adap- 
tive equalization. Projects were formulated involving these applications 
of adaptive filtering; these can be implemented using MATLAB. 


APPLICATIONS IN 
COMMUNICATIONS 


Today MATLAB finds widespread use in the simulation of-a variety of 
communication systems. In this chapter we shall focus on several applica- 
tions dealing with waveform representation and coding, especially speech 
coding, and with digital communications. In particular, we shall describe 
several methods for digitizing analog waveforms, with specific application 
to speech coding and transmission. These methods are pulse-code modula- 
tion (PCM), differential PCM and adaptive differential PCM (ADPOM), 
delta modulation (DM) and adaptive delta modulation (ADM), and lin- 
ear predictive coding (LPC). A project is formulated involving each of 
these waveform encoding methods for simulation using MATLAB. 

The last three topics treated in this chapter deal with signal-detection 
applications that are usually encountered in the implementation of a re- 
ceiver in a digital communication system. For each of these topics we 
describe a project that involves the implementations via simulation of the 
detection scheme in MATLAB. 


PULSE-CODE MODULATION 


Pulse-code modulation is a method for quantizing an analog signal for 
the purpose of transmitting or storing the signal in digital form. PCM is 
widely used for speech transmission in telephone communications and for 
telemetry systems that employ radio transmission. We shall concentrate 
our attention on the application of PCM to speech signal processing. 
Speech signals transmitted over telephone channels are usually limited 
in bandwidth to the frequency range below 4kHz. Hence the Nyquist rate 
for sampling such a signal is less than 8kHz. In PCM the analog speech 
signal is sampled at the nominal rate of 8kHz (samples per second), and 
each sample is quantized to one of 2° levels, and represented digitally by 


ee ——— M——— HG 





a sequence of b bits. Thus the bit rate required to transmit the digitized 
speech signal is 8000 bits per second. 
The quantization process may be modeled mathematically as 


` 8(n) = s(n) + a(n) (10.1) 


where (n) represents the quantized value of s(n), and q(n) represents the 
quantization error, which we treat as an additive noise. Assuming that a 
uniform quantizer is used and the number of levels is sufficiently large, 
the quantization noise is well characterized statistically by the uniform 
probability density function, 


1 A 
=>, -—<q< 10. 
ra= 9 S98 (10.2) 
where the step size of the quantizer is A = 2->. The mean square value 
of the quantization error is 


A 2-2b 
E (e?) = 12 = u2 (10.3) 


Measured in decibels, the mean square value of the noise is 


A2 9-2b 


We observe that the quantization noise decreases by 6 dB/bit used 
in the quantizer. High-quality speech requires a minimum of 12 bits per 
sample and hence a bit rate of 96,000 bits per second (bps). 

Speech signals have the characteristic that small signal amplitudes 
occur more frequently than large signal amplitudes. However, a uniform 
quantizer provides the same spacing between successive levels through- 
out the entire dynamic range of the signal. A better approach is to use 
a nonuniform quantizer, which provides more closely spaced levels at the 
low signal amplitudes and more widely spaced levels at the large signal 
amplitudes. For a nonuniform quantizer with b bits, the resulting quan- 
tization error has a mean square value that is smaller than that given 
by (10.4). A nonuniform quantizer characteristic is usually obtained by 
passing the signal through a nonlinear device that compresses the signal 
amplitude, followed by a uniform quantizer. For example, a logarithmic 
compressor employed in U.S. and Canadian telecommunications systems, 
called a y-law compressor, has an input-output magnitude characteristic 
of the form 


— in( + pleb) 


ma +4) sgn (s); |s| <1, ly] <1 (10.5) 
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where s is the normalized input, y is the normalized output, sgn (-) is the 
sign function, and y is a parameter that is selected to give the desired 
compression characteristic. 

In the encoding of speech waveforms the value of p = 255 has been 
adopted as a standard in the U.S. and Canada. This value results in about 
a 24-dB reduction in the quantization noise power relative to uniform 
quantization. Consequently, an 8-bit quantizer used in conjunction with 
a u = 255 logarithmic compressor produces the same quality speech as a 
12-bit uniform quantizer with no compression. Thus the compressed PCM 
speech signal has a bit rate of 64,000 bps. 

The logarithmic compressor standard used in European telecommu- 
nication systems is called A-law and is defined as 





1+In(A|s 
denis) gn(s, &slss1 

Y=) Au (10.6) 
Trina 28), o«|s x X 


where A is chosen as 87.56. Although (10.5) and (10.6) are different nonlin- 
ear functions, the two compression characteristics are very similar. Figure 
10.1 illustrates these two compression functions. Note their strong simi- 
larity. 

In the reconstruction of the signal from the quantized values, the 
decoder employs an inverse logarithmic relation to expand the signal am- 


lvi 





FIGURE 10.1 Comparison of u-law and A-law nonlinearities 


"P a EE ERR 


388 Chapter 10 @ APPLICATIONS IN COMMUNICATIONS 


fan ee it À—À 





plitude. For example, in p-law the inverse relation is given by 
1 lyi —1 
p= HAE, isu (107) 


The combined compressor-expander pair is termed a compander. 


PROJECT 10.1: The purpose of this project is to gain an understanding of PCM compres- 
PCM sion (linear-to-logarithmic) and PCM expansion (logarithmic-to-linear). 
Write the following three MATLAB functions for this project: 


1. a p-law compressor function to implement (10.5) that accepts a 
zero-mean normalized (|s| < 1) signal and produces a compressed zero- 
mean signal with u as a free parameter that can be specified, 

2. a quantizer function that accepts à zero-mean input and produces 
an integer output after b-bit quantization that can be specified, and 

3. a p-law expander to implement (10.7) that accepts an integer input 
and produces a zero-mean output for a specified p parameter. 


For simulation purposes generate a large number of samples (10,000 
or more) of the following sequences: (a) a sawtooth sequence, (b) an expo- 
nential pulse train sequence, (c) a sinusoidal sequence, and (d) a random 
sequence with small variance. Care must be taken to generate nonperiodic 
sequences by choosing their normalized frequencies as irrational numbers 
(i.e., sample values should not repeat). For example, a sinusoidal sequence 
can be generated using 


s (n) =0.5sin(n/33), O<nS 10,000 


From our discussions in Chapter 2 this sequence is nonperiodic, yet it has 
a periodic envelope. Other sequences can also be generated in a similar 
fashion. Process these signals through the above p-law compressor, quan- 
tizer, and expander functions as shown in Figure 10.2, and compute the 
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FIGURE 10.2 PCM project 
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signal-to-quantization noise ratio (SQNR) in dB as 


N 
Len) 
SQNR = 101og;, | -7 


S (8 - sa (n)? 
n=1 


For different b-bit quantizers, systematically determine the value of u 
that maximizes the SQNR. Also plot the input and output waveforms 
and comment on the results. 


DIFFERENTIAL PCM (DPCM) 
———————n— — 


In PCM each sample of the waveform is encoded independently of all the 
other samples. However, most signals, including speech, sampled at the 
Nyquist rate or faster exhibit significant correlation between successive 
samples. In other words, the average change in amplitude between suc- 
cessive samples is relatively small. Consequently, an encoding scheme that 
exploits the redundancy in the samples will result in a lower bit rate for 
the speech signal. 

A relatively simple solution is to encode the differences between suc- 
cessive samples rather than the samples themselves. Since differences be- 
tween samples are expected to be smaller than the actual sampled ampli- 
tudes, fewer bits are required to represent the differences. A refinement 
of this general approach is to predict the current sample based on the 
previous p samples. To be specific, let s (n) denote the current sample of 
speech and let 3 (n) denote the predicted value of s(n), defined as 


a(n) 2 Y a(i)s(n-i) (10.8) 


i=1 


Thus §(n) is a weighted linear combination of the past p samples, and 
the a (i) are the predictor (filter) coefficients. The a (i) are selected to 
minimize some function of the error between s (n) and 8 (n). 

A mathematically and practically convenient error function is the sum 
of squared errors. With this as the performance index for the predictor, 
we select the a (i) to minimize 


N 
=1 


N A 2 
Ep = ye (n) = X s (n) - Y a(i)s(n- i) (10.9) 
n i=l 


n=1 
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where r5, (m) is the autocorrelation function of the sampled signal se- 
quence s(n), defined as 


N 
rss (m) = > s) si m) (10.10) 
i=1 
Minimization of £j with respect to the predictor coefficients {a;(n)} re- 
sults in the set of linear equations, called the normal equations, 


^ar G7 3) = 106); j=1,2,..-,P (10.11) 


i=1 
or in the matrix form, 
Ra=r=—>a=R'r (10.12) 


where R is the autocorrelation matrix, a is the coefficient vector, and r 
is the autocorrelation vector. Thus the values of the predictor coefficients 
are established. 

Having described the method for determining the predictor coeffi- 
cients, let us now consider the block diagram of a practical DPCM system, 
shown in Figure 10.3. In this configuration the predictor is implemented 
with the feedback loop around the quantizer. The input to the predictor 
is denoted as 8 (n), which represents the signal sample s (n) modified by 
the quantization process, and the output of the predictor is 





p 
$-Y.a()8(n-1) (10.13) 
i=1 
The difference 
e(n) = s(n) —3(n) (10.14) 
éin) ŝin) = 8(n) + éin) 
Channel AR 
converter 


fal 
(a) DPCM Encoder (b) DPCM Decoder 
FIGURE 10.3 Block diagram of a DPCM transcoder: (a) Encoder, (b) Decoder 
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is the input to the quantizer, and ë (n) denotes the output. Each value of 
the quantized prediction error ë (n) is encoded into a sequence of binary 
digits and transmitted over the channel to the receiver. The quantized 
error ë (n) is also added to the predicted value 3 (n) to yield 8 (n). 

At the receiver the same predictor that was used at the transmitting 
end is synthesized, and its output 3 (n) is added to & (n) to yield 5 (n). The 
signal à (n) is the desired excitation for the predictor and also the desired 
output sequence from which the reconstructed signal 8 (t) is obtained by 
filtering, as shown in Figure 10.3b. t 

The use of feedback around the quantizer, as described above, ensures 
that the error in ŝ (n) is simply the quantization error q (n) = &(n)—e(n) 
and that there is no accumulation of previous quantization errors in the 
implementation of the decoder. That is, 


q (n) = & (n) —e (n) = &(n) —8$ (n) -F$ (n) =5 (n) —8 (n) (10.15) 


Hence 8 (n) = s(n) + q (n). This means that the quantized sample 8(n) 
differs from the input s(n) by the quantization error q (n) independent 
of the predictor used. Therefore the quantization errors do not accumu- 
late. 

In the DPCM system illustrated in Figure 10.3, the estimate or pre- 
dicted value 8 (n) of the signal sample s (n) is obtained by taking a linear 
combination of past values 8(n — k), k = 1,2,...,p, as indicated by 
(10.13). An improvement in the quality of the estimate is obtained by 
including linearly filtered past values of the quantized error. Specifically, 
the estimate of s (n) may be expressed as 


p 


3(n) = 32a()8(n— 1) + 9 oliën- i) (10.16) 
i=l 


i=1 


where b (i) are the coefficients of the filter for the quantized error sequence 
& (n). The block diagram of the encoder at the transmitter and the decoder 
at the receiver are shown in Figure 10.4. The two sets of coefficients a (i) 
and b(i) are selected to minimize some function of the error e (n) = 
8 (n) — s (n), such as the sum of squared errors. 

By using a logarithmic compressor and a 4-bit quantizer for the error 
sequence e (n), DPCM results in high-quality speech at a rate of 32,000 
bps, which is a factor of two lower than logarithmic PCM. 


The objective of this project is to gain understanding of the DPCM encod- 
ing and decoding operations. For simulation purposes, generate correlated 
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FIGURE 10.4 DPCM modified by the linearly filtered error sequence 


random sequences using a pole-zero signal model of the form 
s (n) 2 a(1) s(n — 1) + bor (n) + biz (n — 1) (10.17) 


where z (n) is a zero-mean unit variance Gaussian sequence. This can 
be done using the filter function. The sequences developed in Project 
10.1 can also be used for simulation. Develop the following three MATLAB 
modules for this project: 


1. a model predictor function to implement (10.12), given the input 
signal s(n); 

2. a DPCM encoder function to implement the block diagram of Fig- 
ure 10.3a, which accepts a zero-mean input sequence and produces a quan- 
tized b-bit integer error sequence, where b is a free parameter; and 

3. a DPCM decoder function of Figure 10.3b, which reconstructs the 
signal from the quantized error sequence. 


Experiment with several p-order prediction models for a given signal 
and determine the optimum order. Compare this DPCM implementation 
with the PCM system of Project 10.1 and comment on the results. Ex- 
tend this implementation to include an mth-order moving average filter 
as indicated in (10.16). 
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In general, the power in a speech signal varies slowly with time. PCM 
and DPCM encoders, however, are designed on the basis that the speech 
signal power is constant, and hence the quantizer is fixed. The efficiency 
and performance of these encoders can be improved by having them adapt 
to the slowly time-variant power level of the speech signal. 

In both PCM and DPCM the quantization error q (n) resulting from a 
uniform quantizer operating on a slowly varying power level input signal 
will have a time-variant variance (quantization noise power). One im- 
provement that reduces the dynamic range of the quantization noise is 
the use of an adaptive quantizer. 

Adaptive quantizers can be classified as feedforward or feedback. A 
feedforward adaptive quantizer adjusts its step size for each signal sample, 
based on a measurement of the input speech signal variance (power). For 
example, the estimated variance, based as a sliding window estimator, is 


1 n+l 
3 01 2 
D EE Mi (k) (10.18) 


Then the step size for the quantizer is 
A (n41) = A(n) n+ (10.19) 


In this case it is necessary to transmit A (n + 1) to the decoder in order 
for it to reconstruct the signal. 

A feedback adaptive quantizer employs the output of the quantizer 
in the adjustment of the step size. In particular, we may set the step size 
as 


A (n 1) 2 a (n) A (n) (10.20) 


where the scale factor a(n) depends on the previous quantizer output. 
For example, if the previous quantizer output is small, we may select 
a(n) « 1 in order to provide for finer quantization. On the other hand, 
if the quantizer output is large, then the step size should be increased 
to reduce the possibility of signal clipping. Such an algorithm has been 
successfully used in the encoding of speech signals. Figure 10.5 illustrates 
such a (3-bit) quantizer in which the step size is adjusted recursively 
according to the relation 


A (n 1) 2 A(n)- M (n) 
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FIGURE 10.5 Example of a quantizer with an adaptive step size ([10]) 


where M (n) is a multiplication factor whose value depends on the quan- 
tizer level for the sample s (n), and A (n) is the step size of the quantizer 
for processing s(n). Values of the multiplication factors optimized for 
speech encoding have been given by [13]. These values are displayed in 
Table 10.1 for 2-, 3-, and 4-bit quantization for PCM and DPCM. 

In DPCM the predictor can also be made adaptive. Thus in ADPCM 
the coefficients of the predictor are changed periodically to reflect the 
changing signal statistics of the speech. The linear equations given by 
(10.11) still apply, but the short-term autocorrelation function of s (n), 
Tss (m) changes with time. 


TABLE 10.1 Multiplication factors for adaptive step size adjustment ([10]) 
e 


PCM DPCM 
2 3 4 2 8 4 
rn 
M() 0.60 0.85 0.80 0.80 0.90 0.90 
M(2) 2.20 1.00 0.80 1.60 0.90 0.90 
M(3) 1.00 0.80 1.25 0.90 
M(4) 1.50 0.80 1.70 0.90 
M(5) 0.80 1.20 
M(6) 0.80 1.60 
M(7) 0.80 2.00 
M(8) 0.80 2.40 
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FIGURE 10.6 ADPCM block diagram 


ADPCM Figure 10.6 illustrates, in block diagram form, a 32, 000 bps ADPCM en- 
STANDARD coder and decoder that has been adopted as an international (CCITT) 
standard for speech transmission over telephone channels. The ADPCM 
encoder is designed to accept 8-bit PCM compressed signal samples at 
64,000 bps, and by means of adaptive prediction and adaptive 4-bit quan- 
tization to reduce the bit rate over the channel to 32,000 bps. The AD- 
PCM decoder accepts the 32,000 bps data stream and reconstructs the 
signal in the form of an 8-bit compressed PCM at 64,000 bps. Thus we 
have a configuration shown in Figure 10.7, where the ADPCM encoder/ 
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FIGURE 10.7 ADPCM interface to PCM system 
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decoder is embedded into a PCM system. Although the ADPCM encoder/ 
decoder could be used directly on the speech signal, the interface to the 
PCM system is necessary in practice in order to maintain compatibility 
with existing PCM systems that are widely used in the telephone net- 
work. 

The ADPCM encoder accepts the 8-bit PCM compressed signal and 
expands it to à 14-bit-per-sample linear representation for processing. The 
predicted value is subtracted from this 14-bit linear value to produce a 
difference signal sample that is fed to the quantizer. Adaptive quantiza- 
tion is performed on the difference signal to produce a 4-bit output for 
transmission over the channel. 

Both the encoder and decoder update their internal variables, based 
only on the ADPCM values that are generated. Consequently, an ADPCM 
decoder including an inverse adaptive quantizer is embedded in the en- 
coder so that all internal variables are updated, based on the same data. 
This ensures that the encoder and decoder operate in synchronism without 
the need to transmit any information on the values of internal variables. 

The adaptive predictor computes a weighted average of the last six 
dequantized difference values and the last two predicted values. Hence 
this predictor is basically a two-pole (p = 2) and six-zero (m = 6) filter 
governed by the difference equation given by (10.16). The filter coefficients 
are updated adaptively for every new input sample. 

At the receiving decoder and at the decoder that is embedded in 
the encoder, the 4-bit transmitted ADPCM value is used to update the 
inverse adaptive quantizer, whose output is a dequantized version of the 
difference signal. This dequantized value is added to the value generated 
by the adaptive predictor to produce the reconstructed speech sample. 
This signal is the output of the decoder, which is converted to compressed 
PCM format at the receiver. 


The objective of this project is to gain familiarity with, and understanding 
of, ADPCM and its interface with a PCM encoder/decoder (transcoder). 
As described above, the ADPCM transcoder is inserted between the PCM 
compressor and the PCM expander as shown in Figure 10.7. Use the 
already developed MATLAB PCM and DPCM modules for this project. 

The input to the PCM-ADPCM transcoder system can be supplied 
from internally generated waveform data files, just as in the case of the 
PCM project. The output of the transcoder can be plotted. Compar- 
isons should be made between the output signal from the PCM-ADPCM 
transcoder with the signal from the PCM transcoder (PCM project 10.1), 
and with the original input signal. 
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Delta modulation may be viewed as a simplified form of DPCM in which 
a ea a quantizer is used in conjunction with a fixed first-order 
predictor. The block diagram of a DM encoder-decoder is shi in Fi 

10.8. We note that aa 


$(n) = 8(n—1) = 3(n-1) +é(n—1) (10.21) 


Since 
a(n) = &(n) —e(n) = a(n) - [s (n) -3(n)| 
it follows that 


3(n) 2 s(n— 1) - a(n — 1) (10.22) 


Thus the estimated (predicted) value of s (n) is really the previous sam- 
ple s(n — 1) modified by the quantization noise q (n — 1). We also note 
that the difference equation in (10.21) represents an integrator with an 
input é(n). Hence an equivalent realization of the one-step predictor is 
an accumulator with an input equal to the quantized error signal ë (n). In 
general, the quantized error signal is scaled by some value, say A, which 
is called the step size. This equivalent realization is illustrated in Figure 
10.9. In effect, the encoder shown in Figure 10.9 approximates a wave- 
form s(t) by a linear staircase function. In order for the approximation 
to be relatively good, the waveform s (t) must change slowly relative to 















am 
channel 
ŝin) = šin - 1). | Unit delay 
z- 
Encoder 
Lowpass 
deg 


FIGURE 10.8 Block diagram of a delta modulation system 
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FIGURE 10.9 An equivalent realization of a delta modulation system 


the sampling rate. This requirement implies that the sampling rate must 
be several (a factor of at least 5) times the Nyquist rate. A lowpass filter 
is usually incorporated into the decoder to smooth out discontinuities in 


the reconstructed signal. 


At any given sampling rate, the performance of the DM encoder is limited 
by two types of distortion as shown in Figure 10.10. One is called slope- 
overload distortion. It is due to the use of a step size A, that is too small 
to follow portions of the waveform that have a steep slope. The second 
type of distortion, called granular noise, results from using a step size 
that is too large in parts of the waveform having a small slope. The need 
to minimize both of these two types of distortion results in conflicting 
requirements in the selection of the step size Aj. i 

An alternative solution is to employ a variable size that adapts itself 
to the short-term characteristics of the source signal. That is, the step size 
is increased when the waveform has a steep slope and decreased when the 
waveform has a relatively small slope. 


C 








Large A and granular noise 


Small A and slope-overload noise 


FIGURE 10.10 Two types of distortion in the DM encoder 
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A variety of methods can be used to set adaptively the step size in 
every iteration. The quantized error sequence é (n) provides a good indica- 
tion of the slope characteristics of the waveform being encoded. When the 
quantized error &(n) is changing signs between successive iterations, this 
is an indication that the slope of the waveform in the locality is relatively 
small. On the other hand, when the waveform has a steep slope, successive 
values of the error é (n) are expected to have identical signs. From these 
observations it is possible to devise algorithms that decrease or increase 
the step size, depending on successive values of é (n). A relatively simple 
ED by [12] is to vary adaptively the step size according to the 
relation 


A(n) 2 A(n-1) K9* 9-9, &—1,2,... (10.23) 
where K > lisa constant that is selected to minimize the total distortion. 


A block diagram of a DM encoder-decoder that incorporates this adaptive 
algorithm is illustrated in Figure 10.11. 
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FIGURE 10.11 An ezample of a delta modulation system with adaptive step size 
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Several other variations of adaptive DM encoding have been invi 
tigated and described in the technical literature. À particularly effectivi 
and popular technique first proposed by [8] is called continuously variable’, 
slope delta modulation (CVSD). In CVSD the adaptive step size parame- 
ter may be expressed as : 


A(n) -aA(n-1)*k (10.24) 
if ë (n), &(n — 1), and &(n — 2) have the same sign; otherwise 
^ (n) 7 oA (n — 1) t k (10.25) 


The parameters a, ki, and kg are selected such that 0 < a < 1 and 
kı > kg > 0. For more discussion on this and other variations of adaptive 
DM, the interested reader is referred to the papers by [13] and [6] and to 
the extensive references contained in these papers. 


PROJECT 10.4: — The purpose of this project is to gain an understanding of delta modula- 

DM AND ADM tion and adaptive delta modulation for coding of waveforms. This project 
involves writing MATLAB functions for the DM encoder and decoder as 
shown in Figure 10.9, and for the ADM encoder and decoder shown in 
Figure 10.11. The lowpass filter at the decoder can be implemented as à 
linear-phase FIR filter. For example, a Hanning filter that has the impulse 
response 


nin) =3 [tom (5) O0<n<N-1 (10.26) 





may be used, where the length N may be selected in the range 5 < N < 15. 

The input to the DM and ADM systems can be supplied from the 
waveforms generated in Project 10.1 except that the sampling rate should 
be higher by a factor of 5 to 10. The output of the decoder can be plotted. 
Comparisons should be made between the output signal from the DM and 
ADM decoders and the original input signal. 


LINEAR PREDICTIVE CODING (LPC) OF SPEECH 
_ —— 


The linear predictive coding (LPC) method for speech analysis and syn- 
thesis is based on modeling the vocal tract as a linear all-pole (IIR) filter 
having the system function 





H(z)= (10.27) 


p 
14 Y ap (E) zk 
k=1 
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FIGURE 10.12 Block diagram model for the generation of a speech signal 


where p is the number of poles, G is the filter gain, and {ap (k)} are the 
parameters that determine the poles. There are two mutually exclusive 
excitation functions to model voiced and unvoiced speech sounds. On a 
short-time basis, voiced speech is periodic with a fundamental frequency 
Fo, or a pitch period 1/Fo, which depends on the speaker. Thus voiced 
speech is generated by exciting the all-pole filter model by a periodic 
impulse train with a period equal to the desired pitch period. Unvoiced 
speech sounds are generated by exciting the all-pole filter model by the 
output of a random-noise generator. This model is shown in Figure 10.12. 

Given a short-time segment of a speech signal, usually about 20 ms or 
160 samples at an 8 kHz sampling rate, the speech encoder at the trans- 
mitter must determine the proper excitation function, the pitch period for 
voiced speech, the gain parameter G, and the coefficients ap (k). A block 
diagram that illustrates the speech encoding system is given in Figure 
10.13. The parameters of the model are determined adaptively from the 
data and encoded into a binary sequence and transmitted to the receiver. 
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FIGURE 10.13 Encoder and decoder for LPC 
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At the receiver the speech signal is synthesized from the model and the 
excitation signal. 

The parameters of the all-pole filter model are easily determined from 
the speech samples by means of linear prediction. To be specific, the 
output of the FIR linear prediction filter is : 


8(n)-— Y ap (k) s(n — k) (10.28) 
k=1 


and the corresponding error between the observed sample s(n) and the 
predicted value ŝ (n) is 


e(n) = s(n)+ Y ap (k) s(n — k) (10.29) 
k=1 


By minimizing the sum of squared errors, that is, 


N N p 2 
E= e (n)= Z | (n) + 5 ap (k) (n — »| (10.30) 
k=1 


n=0 n=0 


we can determine the pole parameters (a; (k)} of the model. The result 
of differentiating € with respect to each of the parameters and equating 
the result to zero, is a set of p linear equations 


Yia (k) rss (m — k) 2 rss (m), m-12...p (10.31) 
k=1 


where r,s (m) is the autocorrelation of the sequence s (n) defined as 


N 


Tes (m) = bR s(n)s(n+m) (10.32) 


n=0 
The linear equations (10.31) can be expressed in matrix form as 
R,,a = -Tss (10.33) 


where R,, is a p X p autocorrelation matrix, Tss is a p X l autocorrelation 
vector, and a is a p x 1 vector of model parameters. Hence 


a = -R; 1.5 (10.34) 


These equations can also be solved recursively and most efficiently, with- 
out resorting to matrix inversion, by using the Levinson-Durbin algorithm 
[19]. However, in MATLAB it is convenient to use the matrix inversion. The 
all-pole filter parameters {ap (k)} can be converted to the all-pole lattice 
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parameters (K;) (called the reflection coefficients) using the MATLAB 
function dir21atc developed in Chapter 6. 


The gain parameter of the filter can be obtained by noting that its 
input-output equation is 


P 
s(n) = — Yap (K) s(n — k) + Ga (n) (10.35) 
k-i 
where z (n) is the input sequence. Clearly, 


Gz (n) = s(n) +> ap (k) s(n — k) =e(n) 
k=1 


Then 


N-1 N-1 
ELE 2? (n) = Ye? (n) (10.36) 


n=0 n=0 


If the input excitation is normalized to unit energy by design, then 


N-1 P 
G? = Y è (n) = ras (0) + Y ap (k) rss (k) (10.37) 
k=1 


n=0 


Thus G? is set equal to the residual energy resulting from the least-squares 
optimization. 

Once the LPC coefficients are computed, we can determine whether 
the input speech frame is voiced, and if so, what the pitch is. This is 
accomplished by computing the sequence 


p 
re (n) = Y ra (K) rss (n — E) (10.38) 


k=1 


where r, (k) is defined as 


p 
ra (k) = Y ap (i) ap (i +k) (10.39) 


i=1 


which is the autocorrelation sequence of the prediction coefficients. 
The pitch is detected by finding the peak of the normalized sequence 
re (n) /re (0) in the time interval that corresponds to 3 to 15 ms in the 
20-ms sampling frame. If the value of this peak is at least 0.25, the frame 
of speech is considered voiced with a pitch period equal to the value of 
n = Np, where re (Np) /Te (0) is a maximum. If the peak value is less than 
0.25, the frame of speech is considered unvoiced and the pitch is zero. 
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PROJECT 10.5: 
LPC 


The values of the LPC coefficients, the pitch period, and the type of 
excitation are transmitted to the receiver, where the decoder synthesizes 
the speech signal by passing the proper excitation through the all-pole 
filter model of the vocal tract. Typically, the pitch period requires 6 bits, 
and the gain parameter may be represented by 5 bits after its dynamic 
range is compressed logarithmically. If the prediction coefficients were to 
be coded, they would require between 8 to 10 bits per coefficient for accu- 
rate representation. The reason for such high accuracy is that relatively 
small changes in the prediction coefficients result in a large change in 
the pole positions of the filter model. The accuracy requirements are less- 
ened by transmitting the reflection coefficients (K;), which have a smaller 
dynamic range—that is, |K;| « 1. These are adequately represented by 
6 bits per coefficient. Thus for a 10th-order predictor the total number 
of bits assigned to the model parameters per frame is 72. If the model 
parameters are changed every 20 milliseconds, the resulting bit rate is 
3,600 bps. Since the reflection coefficients are usually transmitted to the 
receiver, the synthesis filter at the receiver is implemented as an all-pole 
lattice filter, described in Chapter 6. 


The objective of this project is to analyze a speech signal through an 
LPC coder and then to synthesize it through the corresponding PLC 
decoder. Use several .wav sound files (sampled at 8000 sam/sec rate), 
which are available in MATLAB for this purpose. Divide speech signals 
into short-time segments (with lengths between 120 and 150 samples) and 
process each segment to determine the proper excitation function (voiced 
or unvoiced), the pitch period for voiced speech, the coefficients {ap (k)} 
(p < 10), and the gain G. The decoder that performs the synthesis is an 
all-pole lattice filter whose parameters are the reflection coefficients that 
can be determined from {a, (k)}. The output of this project is a synthetic 
speech signal that can be compared with the original speech signal. The 
distortion effects due to LPC analysis/synthesis may be assessed qualita- 
tively. 


DUAL-TONE MULTIFREQUENCY (DTMF) SIGNALS 
__ te 


DTMF is the generic name for push-button telephone signaling that is 
equivalent to the Touch Tone system in use within the Bell System. DTMF 
also finds widespread use in electronic mail systems and telephone banking 
systems in which the user can select options from a menu by sending 
DTMF signals from a telephone. 

In a DTMF signaling system a combination of a high-frequency tone 
and a low-frequency tone represent a specific digit or the characters * 
and #. The eight frequencies are arranged as shown in Figure 10.14, to 
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Col 1 Co! 2 Col 3 Col 4 
1209Hz  1336Hz  1477Hz  1633Hz 


Row 1 697 Hz 


Row 2 770 Hz 


Row 3 852 Hz 


Row 4 941 Hz 





DTMF digit = row tone + column tone 


FIGURE 10.14 DTMF digits 


accommodate a total of 16 characters, 12 of which are assigned as shown, 
while the other four are reserved for future use. 

DTMF signals are easily generated in software and detected by means 
of digital filters, also implemented in software, that are tuned to the eight 
frequency tones. Usually, DTMF signals are interfaced to the analog world 
via a codec (coder/decoder) chip or by linear A/D and D/A converters. 
Codec chips contain all the necessary A/D and D/A, sampling, and fil- 
tering circuitry for a bi-directional analog/digital interface. 

The DTMF tones may be generated either mathematically or from a 
look-up table. In a hardware implementation (e.g., in a digital signal pro- 
cessor), digital samples of two sine waves are generated mathematically, 
scaled, and added together. The sum is logarithmically compressed and 
sent to the codec for conversion to an analog signal. Át an 8 kHz sam- 
pling rate the hardware must output a sample every 125 ms. In this case 
a sine look-up table is not used because the values of the sine wave can be 
computed quickly without using the large amount of data memory that 
a table look-up would require. For simulation and investigation purposes 
the look-up table might be a good approach in MATLAB. 

At the receiving end the logarithmically compressed, 8-bit digital data 
words from the codec are received, logarithmically expanded to their 16- 
bit linear format, and then the tones are detected to decide on the trans- 
mitted digit. The detection algorithm can be a DFT implementation us- 
ing the FFT algorithm or a filter bank implementation. For the relatively 
small number of tones to be detected, the filter bank implementation is 
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more efficient. Below, we describe the use of the Goertzel algorithm to 
implement the eight, tuned filters. : 

Recall from the discussion in Chapter 5 that the DFT of an N-point 
data sequence (x (n)) is 


N-1 
X(k)= Y s(n) WR, k201..,N-1 (10.40) 


n=0 


If the FFT algorithm is used to perform the computation of the DFT, 
the number of computations (complex multiplications and additions) is 
N log, N. In this case we obtain all N values of the DFT at once. However, 
if we desire to compute only M points of the DFT, where M < log, N, 
then a direct computation of the DFT is more efficient. The Goertzel 
algorithm, which is described below, is basically a linear filtering approach 
to the computation of the DFT, and provides an alternative to direct 
computation. 


The Goertzel algorithm exploits the periodicity of the phase factors {Wn} 
and allows us to express the computation of the DFT as a linear filtering 
operation. Since wy” = 1, we can multiply the DFT by this factor. 
Thus 


N-1 
X (k) = Wy X (k) = Y, (m) Wa" o 79 (10.41) 


m=0 


We note that (10.41) is in the form of a convolution. Indeed, if we define 
the sequence yx (n) as 


N-1 
y. (n) = > s (m) Wy 7 (10.42) 


m=0 


then it is clear that yx (n) is the convolution of the finite-duration input 
sequence z (n) of length N with a filter that has an impulse response 


hy (n) = Wy*"u(n) (10.43) 


The output of this filter at n = N yields the value of the DFT at the 
frequency ux = 2xk/N. That is, 


X (k) = w (Ml new (10.44) 


as can be verified by comparing (10.41) with (10.42). 
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The filter with impulse response hy (n) has the system function 


1 


Hy (z) = 1- Wyte 


(10.45) 


This filter has a pole on the unit circle at the frequency uy = 2rk/N. 
Thus the entire DFT can be computed by passing the block of input data 
into a parallel bank of N single-pole filters (resonators), where each filter 
has a pole at the corresponding frequency of the DFT. 

Instead of performing the computation of the DFT as in (10.42), via 
convolution, we can use the difference equation corresponding to the filter 
given by (10.45) to compute y; (n) recursively. Thus we have 


yk (n) 2 Wg*yk(n-1)4z(n), yk(-1)=0 (10.46) 


The desired output is X (k) = yx (N). To perform this computation, we 
can compute once and store the phase factor Wg". 

The complex multiplications and additions inherent in (10.46) can 
be avoided by combining the pairs of resonators possessing complex con- 
n poles. This leads to two-pole filters with system functions of the 
orm 


1—- Wkz-! 
Hk (2) = i NT (10.47) 


— 2cos (2nk/N) z-! + z-? 


The realization of the system illustrated in Figure 10.15 is described by 
the difference equations 


vy (n) = 2cos eo (n — 1) — v (n - 2) 4 z (n) (10.48) 


yk (n) = v. (n) — Weg (n — 1) (10.49) 
CO © 
O—< > 


FIGURE 10.15 Realization of two-pole resonator for computing the DFT 


x(n} yk (N) = X(k) 
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with initial conditions vy (—1) = ve (—2) = 0. This is the Goertzel algo- 
rithm. 

The recursive relation in (10.48) is iterated for n = 0,1,..., N, but the 
equation in (10.49) is computed only once, at time n = N. Each iteration 
requires one real multiplication and two additions. Consequently, for a real 
input sequence z (n), this algorithm requires N +1 real multiplications to 
yield not only X (k) but also, due to symmetry, the value of X (N — k). 

We can now implement the DTMF decoder by use of the Goertzel 
algorithm. Since there are eight possible tones to be detected, we require 
eight filters of the type given by (10.47), with each filter tuned to one of the 
eight frequencies. In the DTMF detector, there is no need to compute the 
complex value X (k); only the magnitude |X (k)] or the magnitude-squared 
value |X (k)i? will suffice. Consequently, the final step in the computation 
of the DFT value involving the numerator term (feedforward part of the 
filter computation) can be simplified. In particular, we have 


IX (KP? = lyr QE. = [ur (N) - Who (N — 1)? (10.50) 


=v (N) +02 (N - 1)- (2e 75") vy (N) v (N — 1) 


Thus complex-valued arithmetic operations are completely eliminated in 
the DTMF detector. 


The objective of this project is to gain an understanding of the DTMF 
tone generation software and the DTMF decoding algorithm (the Goertzel 
algorithm). Design the following MATLAB modules: 


1. a tone generation function that accepts an array containing dial- 
ing digits and produces a signal containing appropriate tones (from Figure 
10.14) of one-half-second duration for each digit at 8 kHz sampling fre- 
quency, 

2. a dial-tone generator generating samples of (350 + 440) Hz fre- 
quency at 8 kHz sampling interval for a specified amount of duration, 
and 

3. a decoding function to implement (10.50) that accepts a DTMF 
signal and produces an array containing dialing digits. 


Generate several dialing list arrays containing a mix of digits and dial 
tones. Experiment with the tone generation and detection modules and 
comment on your observations. Use MATLAB's sound generation capabil- 
ities to listen to the tones and to observe the frequency components of 
the generated tones. 
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Digitized speech signals that have been encoded via PCM, ADPCM, DM, 
and LPC are usually transmitted to the decoder by means of digital modu- 
lation. A binary digital communications system employs two signal wave- 
forms, say s1(£) = s(t) and so(t) = —s(t), to transmit the binary sequence 
representing the speech signal. The signal waveform S(t), which is nonzero 
over the interval 0 < t € T, is transmitted to the receiver if the data bit 
is a 1, and the signal waveform —s(t), 0 < t < T is transmitted if the data 
bit is à 0. The time interval T' is called the signal interval, and the bit 
rate over the channel is R = 1/T bits per second. A typical signal wave- 
form s(t) is a rectangular pulse—that is, s(t) = A, 0 <t < T—which has 
energy A?T. 

In practice the signal waveforms transmitted over the channel are 
corrupted by additive noise and other types of channel distortions that 
ultimately limit the performance of the communications system. As & 
measure of performance we normally use the average probability of error, 
which is often called the bit error rate. 


The purpose of this project is to investigate the performance of a binary 
data communications system on an additive noise channel by means of 
simulation. The basic configuration of the system to be simulated is shown 
in Figure 10.16. Five MATLAB functions are required. 


1. A binary data generator module that generates a sequence of in- 
dependent binary digits with equal probability. 

2. A modulator module that maps a binary digit 1 into a sequence 
of M consecutive +1’s, and maps a binary digit 0 into a sequence of 
M consecutive —1’s. Thus the M consecutive +1’s represent a sampled 
version of the rectangular pulse. 

3. A noise generator that generates a sequence of uniformly dis- 
tributed numbers over the interval (—a, a). Each noise sample is added to 
a corresponding signal sample. 


1 


Demodulator Detector and 
error counter 






Binary data 
generator 





generator 


FIGURE 10.16 Model of binary data communications system 
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4. A demodulator module that sums the M successive outputs of 
the noise corrupted sequence +1’s or —1’s received from the channel. We 
assume that the demodulator is time synchronized so that it knows the 
beginning and end of each waveform. 

5. A detector and error-counting module. The detector compares the 
output of the modulator with zero and decides in favor of 1 if the output 
is greater than zero and in favor of 0 if the output is less than zero. If the 
output of the detector does not agree with the transmitted bit from the 
transmitter, an error is counted by the counter. The error rate depends 
on the ratio (called signal-to-noise ratio) of the size of M to the additive 
noise power, which is P, = a? /3. 


The measured error rate can be plotted for different signal-to-noise 
ratios, either by changing M and keeping P, fixed or vice versa. 


SPREAD-SPECTRUM COMMUNICATIONS 
a lo 


Spread-spectrum signals are often used in the transmission of digital data 
over communication channels that are corrupted by interference due to 
intentional jamming or from other users of the channel (e.g., cellular tele- 
phones and other wireless applications). In applications other than com- 
munications, spread-spectrum signals are used to obtain accurate range 
(time delay) and range rate (velocity) measurements in radar and navi- 
gation. For the sake of brevity we shall limit our discussion to the use of 
spread spectrum for digital communications. Such signals have the char- 
acteristic that their bandwidth is much greater than the information rate 
in bits per second. 

In combatting intentional interference (jamming), it is important to 
the communicators that the jammer who is trying to disrupt their com- 
munication does not have prior knowledge of the signal characteristics. To 
accomplish this, the transmitter introduces an element of unpredictability 
or randomness (pseudo-randomness) in each of the possible transmitted 
signal waveforms, which is known to the intended receiver, but not to the 
jammer. As a consequence, the jammer must transmit an interfering sig- 
nal without knowledge of the pseudo-random characteristics of the denied 
signal. 

Interference from other users arises in multiple-access communica- 
tions systems in which a number of users share a common communications 
channel. At any given time a subset of these users may transmit informa- 
tion simultaneously over a common channel to corresponding receivers. 
The transmitted signals in this common channel may be distinguished 
from one another by superimposing a different pseudo-random pattern, 
called a multiple-access code, in each transmitted signal. Thus a particular 
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receiver can recover the transmitted data intended for it by knowing the 
pseudo-random pattern, that is, the key used by the corresponding trans- 
mitter. This type of communication technique, which allows multiple users 
to simultaneously use a common channel for data transmission, is called 
code division multiple access (CDMA). 

The block diagram shown in Figure 10.17 illustrates the basic el- 
ements of a spread-spectrum digital communications system. It differs 
from a conventional digital communications system by the inclusion of 
two identical pseudo-random pattern generators, one that interfaces with 
the modulator at the transmitting end, and the second that interfaces with 
the demodulator at the receiving end. The generators generate a pseudo- 
random or pseudo-noise (PN) binary-valued sequence (+1’s), which is 
impressed on the transmitted signal at the modulator and removed from 
the received signal at the demodulator. 

Synchronization of the PN sequence generated at the demodulator 
with the PN sequence contained in the incoming received signal is re- 
quired in order to demodulate the received signal. Initially, prior to the 
transmission of data, synchronization is achieved by transmitting a short 
fixed PN sequence to the receiver for purposes of establishing synchro- 
nization. After time synchronization of the PN generators is established, 
the transmission of data commences. 


The objective of this project is to demonstrate the effectiveness of a PN 
spread-spectrum signal in suppressing sinusoidal interference. Let us con- 
sider the binary communication system described in Project 10.7, and let 
us multiply the output of the modulator by a binary (+1) PN sequence. 
The same binary PN sequence is used to multiply the input to the demod- 
ulator and thus to remove the effect of the PN sequence in the desired 
signal. The channel corrupts the transmitted signal by the addition of a 
wideband noise sequence {w(n)} and a sinusoidal interference sequence 
of the form i(n) = Asinwon, where 0 < wo < 7. We may assume that 
A > M, where M is the number of samples per bit from the modulator. 
The basic binary spread spectrum-system is shown in Figure 10.18. As can 
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FIGURE 10.17 Basic spread spectrum digital communications system 
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FIGURE 10.18 Block diagram of binary PN spread-spectrum system for simula- 
tion experiment 


be observed, this is just the binary digital communication system shown 
in Figure 10.16, to which we have added the sinusoidal interference and 
the PN sequence generators. The PN sequence may be generated by using 
a random-number generator to generate a sequence of equally probable 
ils. 

Execute the simulated system with and without the use of the PN 
sequence, and measure the error rate under the condition that A > M for 
different values of M, such as M = 50, 100, 500, 1000. Explain the effect 
of the PN sequence on the sinusoidal interference signal. Thus explain 
why the PN spread-spectrum system outperforms the conventional binary 
communication system in the presence of the sinusoidal jamming signal. 


———— 


Tn this chapter we focused on applications to waveform representation and 
coding. In particular, we described several methods for digitizing an ana- 
log waveform, including PCM, DPCM, ADPCM, DM, ADM, and LPC. 
These methods have been widely used for speech coding and transmission. 
Projects involving these waveform encoding methods were formulated for 
implementation via simulation in MATLAB. 

We also described signal-detection and communication systems where 
MATLAB may be used to perform the signal processing tasks. Projects 
were also devised for these applications. 
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(see Fast Fourier transform) 
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frequency sampling, 264 
IIR filter, 301 
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Difference equation, 29 
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Fourier transform 
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shifting, 12 
signal addition, 10 
signal energy, 13 
signal multiplication, 11 
signal power, 13 
Optimum filter, 376 
Overlap-add method of 
convolution, 160 
Overlap-save method of 
convolution, 158 
high-speed, 170 
Overview of digital signal 
processing, 2 
ovrlpadd, 178 
ovrlpsav, 159 


par2dir, 193 
Parallel form, IIR filter structure, 
184, 190 
parfiltr, 192 
Parks-McClelian, 415 
algorithm, 284 
Particular solution, 30, 105, 107 
Passband cutoff frequency, 302 
Passband ripple parameter, 302 
Passband tolerance, 225 
Peak side lobe magnitude, 246 
Period, fundamental, 10 
Periodic conjugate symmetry, 
142 
Periodic sequences, 10, 117 
Periodic shift, 146 
Periodicity, M-fold, 173 
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causal LTI stability theorem, 
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LTI stability theorem, 103 
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124 
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z-domain system function, 95 
z-transform 
the bilateral, 80 
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inverse, 81, 89 
linearity, 84 
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table, 87 
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spectral, 350 Windows interpolation, 68 
Transient response, 105, 107 Bartlett (triangular), 248 Zero-padding, 135 
Transition band tolerance, 225 Blackman, 250 Zero-state response, 33, 105, 107 
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